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ABSTRACT 



A large-scale evaluation was conducted of Jobs-First GAIN, a 
strongly employment -focused mandatory welfare -to- work program. Its main 
features were an unusually intensive program orientation; high quality job 
clubs; job development activities; strong encouragement to take entry-level 
jobs and combine work and welfare in the short-term; and relatively tough, 
enforcement-oriented case management. The research sample included 15,683 
single parents and 5,048 members of 2 -parent families. The net cost of 
Jobs-First GAIN was relatively low. These impacts for single parents were 
identified: Jobs-First GAIN led to substantial two-year increases in 
employment and earnings; modest reductions in welfare and Food Stamp receipts 
and large reductions in welfare and Food Stamp payments were produced; a 
small net increase in total income in year 2 was produced; use of child care 
increased, as did the incidence of child care problems that affected 
employment; the child outcomes examined showed no systematic effects; larger 
employment and earnings gains were achieved than with the county's previous, 
basic-education-focused program; many different types of welfare recipients 
were benefited; and costs were more than offset by savings in welfare 
payments and other types of assistance. Impacts for two-parent families were 
somewhat larger than for single-parent families. Two-year earnings gains 
increased for both men and women in two-parent families, with the average 
gain for men being nearly twice as large as women's. (YLB) 



Reproductions supplied by EDRS are the best that can be made 
from the original document. 



The Los Angeles Jobs-First 

GAIN Evaluation 



Final Report on a Work First 
Program in a Major Urban Center 






'tephen Freedman 
?an Tansey Knab 
?a A. Gennetian 
)avid Navarro 

June 2000 




MDRC 



ERIC 




U.S. DEPARTMENT OF EDUCATION 
Office of Educational Research end improvement 
EDUCATIONAL RESOURCES INFORMATION 
y CENTER (ERIC) 

>0 This document has been reproduced as 
f received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 



BEST COPY AVAILABLE ' 






PAUL H. O'NEILL, Chairman 

Chairman and CEO 

Alcoa 

ROBERT SOLOW, Vice Chairman 
Institute Professor 

Massachusetts Institute of Technology 

RUDOLPH G. PENNER, Treasurer 
Senior Fellow 
Urban Institute 



MARY JO BANE 

Professor of Public Policy 

John F. Kennedy School of Government 

Harvard University 

REBECCA M. BLANK 
Dean 

Gerald R. Ford School of Public Policy 
University of Michigan 

JAMES H. JOHNSON, JR. 

E. Maynard Adams Professor of Business, 
Geography, and Sociology 
Director, Urban Investment Strategies Center 
University of North Carolina 



RICHARD J. MURNANE 

Professor of Education 
Graduate School of Education 
Harvard University 

MARION O. SANDLER 
Chairman and CEO 

Golden West Financial Corporation and 
World Savings and Loan Association 

ISABEL V. SAWHILL 
Senior Fellow 
Brookings Institution 

LAWRENCE J. STUPSKI 

Chairman 

Stupski Family Foundation 

WILLIAM JULIUS WILSON 

Malcolm Wiener Professor of Social Policy 
John F. Kennedy School of Government 
Harvard University 



JUDITH M. GUERON 

President 

Manpower Demonstration Research Corporation 



MDRC 



3 



O 

ERIC 



The Los Angeles Jobs-First 
GAIN Evaluation 

Final Report on a Work First Program 
in a Major Urban Center 




4 



The Manpower Demonstration Research Corporation conducted the Los Angeles Jobs- 
First GAIN Evaluation under a contract with the Los Angeles Department of Public Social 
Services. The U.S. Department of Health and Human Services, Administration for 
Children and Families, and the Ford Foundation provided additional funding for the 
evaluation. 

Dissemination of MDRC’s work is also supported by MDRC’s Public Policy Outreach Funders: 
the Ford Foundation, the Ambrose Monell Foundation, the Alcoa Foundation, and the James 
Irvine Foundation. 

The findings and conclusions in this report do not necessarily represent the official positions or 
policies of the funders. 



For information about MDRC, see our Web site: www.mdrc.org. 

MDRC® is a registered trademark of the Manpower Demonstration Research Corporation. 



Copyright © 2000 by the Manpower Demonstration Research Corporation. All rights reserved. 



Contents 



List of Tables and Figures 


V 


Preface 




ix 


Ackn owledgments 


xi 


Executive Summary 


ES- 


1 Introduction 


1 


I. 


Summary of Los Angeles County’s Welfare Reform Efforts 


2 


II. 


Key Features of Jobs-First GAIN 


7 


in. 


New Program Features of CalWORKs 


12 


IV. 


An Overview of the Evaluation 


14 


V. 


The Research Sample and Program Environment 


16 


VI. 


The Program Environment 


18 


VII. 


Research Questions for This Report 


23 


VIII. 


Data Sources for This Report 


29 


IX. 


The Contents of This Report 


31 


2 Participation in Employment-Related Activities After Random 




Assignment 


32 


I. 


Key Findings 


32 


II. 


Framework for Interpreting Participation Findings 


33 


III. 


Results for AFDC-FGs 


36 


IV. 


Results for AFDC-Us 


46 


3 Costs of Jobs-First GAIN 


52 


I. 


Key Findings 


52 


II. 


Major Components of the Cost Analysis 


53 


III. 


Jobs-First GAIN-Related Cost per AFDC-FG Experimental 
Group Member 


54 


IV. 


Non- Jobs-First GAIN Cost per AFDC-FG Experimental 
Group Member 


60 


V. 


Gross Cost per AFDC-FG Experimental Group Member 


61 


VI. 


Gross Cost per AFDC-FG Control Group Member 


62 


vn. 


Net Cost per AFDC-FG Experimental Group Member 


62 


VIII. 


Summary of Cost Estimates for AFDC-Us 


63 


4 Impacts for AFDC-FGs 


68 


I. 


Key Findings 


68 


n. 


Background Information for Interpreting Results 


69 


in. 


Impacts on Employment and Earnings 


72 


IV. 


Impacts on Public Assistance 


91 


V. 


Comparisons with Previously Evaluated Programs 


92 


VI. 


Subgroup Impacts 


98 




-iii- 



G 



5 Impacts on Self-Sufficiency, Income, and Material Well-Being 

for AFDC-FGs 109 

I. Key Findings 109 

II. Analysis Issues 110 

III. Impacts on Self-Sufficiency 112 

IV. Impacts on Income 116 

V. Impacts on Health Coverage, SSI, and Noncash Benefits 121 

VI. Impacts on Other Indicators of Well-Being 128 

6 Impacts on Child Care, Home Environment, and Child Outcomes 

for Children of AFDC-FGs 132 

I. Key Findings 132 

II. Child Care 133 

IB. Household Composition, Fertility, and Home Environment 144 

IV. Jobs-First GAIN’S Impacts on Child Outcomes 146 

V. Conclusions 159 

7 Impacts for AFDC-Us 160 

I. Key Findings 1 60 

II. Background Information for Interpreting Results 161 

III. Impacts on Employment and Earnings 164 

IV. Impacts on Public Assistance 171 

V. Impacts on Employment and Welfare Status After Two Years 1 75 

VI. Impacts on Combined Income from Earnings, AFDC/TANF, 

and Food Stamps 177 

VII. Subgroup Impacts 177 

8 Benefit-Cost Analysis 189 

I. Key Findings 189 

II. Analytical Approach 190 

III. Benefits and Costs for AFDC-FGs 193 

IV. Comparing Benefits and Costs for AFDC-FGs 198 

V. Summary of Benefits and Costs for AFDC-Us 202 

References 209 

Recent Publications on MDRC Projects 217 



7 

o 

ERLC 



-IV- 



Tables and Figures 



Table 

1 Key Features of Wei fare- to- Work Programs in Los Angeles ES-7 

2 Two-Year Impacts on Employment, Earnings, Welfare, and Food Stamps 

for Single Parents ES-14 

3 Impacts on Job Characteristics at the End of Year 2 for Single Parents ES-16 

4 Impacts on Child Care Use During Current or Most Recent Job for Single Parents 

Overall and by Age of Youngest Child at Random Assignment ES-21 

5 Impacts on Maternal Reports of Child Outcomes for Children of Single Parents, 

by Child’s Age at Random Assignment ES-24 

6 Comparison of Jobs-First GAIN’S Impacts with Los Angeles GAIN’S Impacts ES-25 

7 Two-Year Impacts on Employment, Earnings, Welfare, and Food Stamps 

for Members of Two-Parent Families ES-29 

1 . 1 Selected Characteristics of Los Angeles GAIN, Jobs-First GAIN, and Cal WORKs 4 

1 .2 Characteristics of the Program Environment, Los Angeles County 8 

1 .3 Overview of Sample Sizes, by Assistance Category, Enrollment Status, 

and Research Group 1 7 

1.4 Demographic Characteristics of the Full Sample 19 

2 . 1 Rates of Participation and Status Within Two Years of Orientation for AFDC-FG 

Experimental Group Members 37 

2.2 Participation Patterns Within Two Years of Orientation for AFDC-FG Experimental 

Group Members Who Participated in Jobs-First GAIN Activities 38 

2.3 Rates of Participation and Status Among AFDC-FG Experimental 

Group Members Within Two Years of Orientation, by Region and Subgroup 42 

2.4 Two-Year Impacts on Rates and Total Hours of Participation in Jobs-First GAIN 

and non- Jobs-First GAIN Activities for AFDC-FGs 45 

2.5 Rates of Participation and Status Within Two Years of Orientation 

for AFDC-U Experimental Group Members 48 

2.6 Rates of Participation and Status Among AFDC-U Experimental 

Group Members Within TwoYears of Orientation, by Region and Subgroup 49 



O 

ERIC 



-v- 



8 



3 . 1 Estimated Unit Costs of Employment-Related Activities per AFDC-FG 

Experimental and Control Group Member (in 1998 Dollars) 56 

3.2 Estimated Costs per AFDC-FG Experimental and Control Group Member 

Within Two Years of Orientation, by Agency (in 1998 Dollars) 57 

3.3 Estimated Costs per AFDC-U Experimental and Control Group Member 

Within Two Years of Orientation, by Agency (in 1998 Dollars) 65 

4.1 Two-Year Impacts on Employment, Earnings, AFDC/TANF, Food Stamps, 

and Combined Income for AFDC-FGs 73 

4.2 Impacts on Measures of Employment Stability and Eamings Growth 

in Years 1 and 2 for AFDC-FGs 81 

4.3 Impacts on Employment and Eamings for AFDC-FGs Based on Survey Data 86 

4.4 Characteristics of First and Current Job for AFDC-FGs Who 

Worked for Pay After Random Assignment 89 

4.5 Comparison of Jobs-First GAIN’S Impacts and the Impacts of 

Los Angeles GAIN, Riverside GAIN, and Riverside LFA for AFDC-FGs 94 

4.6 Impacts on Employment, Eamings, and AFDC/TANF Payments and Receipt 

for AFDC-FGs, by Region and Subgroup 100 

5.1 Impacts on Employment and AFDC/TANF Status of AFDC-FGs and 

on Measured Income from Other Household Members at the End of Year 2 117 

5.2 Impacts on Measured Income at the End of Year 2 for AFDC-FGs 122 

5.3 Impacts on Receipt of Various Types of Income for AFDC-FG Respondents 

and Other Household Members at the End of Year 2 124 

5.4 Impacts on Medical Coverage and Receipt of Noncash Benefits for AFDC-FGs 126 

5.5 Impacts on Housing Situation, Food Insecurity, and Quality of Life 

of AFDC-FGs in Year 2 130 

6.1 Impacts on Use and Cost of Child Care and Child Care Assistance for AFDC-FGs 138 

6.2 Use, Cost, and Reliability of Child Care for AFDC-FGs, by Age of Youngest Child 142 

6.3 Impacts on Household Composition and Home Environment for AFDC-FGs 147 

6.4 Impacts on Maternal Reports of Child Outcomes for Children of AFDC-FGs 153 

6.5 Impacts on Maternal Reports of Child Outcomes for Children of AFDC-FGs, 

by Child Age 155 



O 

ERIC 



•VI- 



9 



6.6 Impacts on Maternal Reports of Child Outcomes for Children of AFDC-FGs, 

by Child Gender 157 

7.1 Two-Year Impacts on Employment, Earnings, AFDC/TANF, Food Stamps, 

and Combined Income for AFDC-Us 1 65 

7.2 Impacts on Measures of Employment Stability and Earnings Growth 

in Years 1 and 2 for AFDC-Us 174 

7.3 Impacts on Employment, Earnings, and AFDC/TANF Payments and Receipt 

for AFDC-Us, by Region and Subgroup 178 

8.1 Estimated Effects on Benefit-Cost Measures over Five Years After 
Random Assignment, per AFDC-FG Experimental Group Member 

(in 1998 Dollars) 194 

8.2 From the Perspective of the Welfare Sample: Estimated Monetary Gains 
and Losses per AFDC-FG Experimental Group Member over Two and 

Five Years (in 1998 Dollars) 199 

8.3 From the Perspective of the Government: Estimated Monetary Gains and 
Losses per AFDC-FG Experimental Group Member over Two and Five Years 

(in 1 998 Dollars) 200 

8.4 Estimated Effects on Benefit-Cost Measures over Five Years 

After Random Assignment, per AFDC-U Experimental Group Member 

(in 1998 Dollars) 203 

8.5 From the Perspective of the Welfare Sample: Estimated Monetary Gains 

and Losses per AFDC-U Experimental Group Member over Two and Five Years 

(in 1998 Dollars) 206 

8.6 From the Perspective of the Government: Estimated Monetary Gains 

and Losses per AFDC-U Experimental Group Member over Two and Five Years 

(in 1998 Dollars) 207 

Figure 

1 Two-Year Impacts on Participation in Employment-Related Activities 

for Single Parents ES-12 

2 Employment and Welfare Status at the End of Years 1 and 2 for Single Parents ES-18 

3 Two-Year Impacts on Earnings Gains and Welfare Savings for Selected 

Subgroups of Single Parents ES-27 



4 Two-Year Impacts on Earnings Gains and Welfare Savings for Selected 

Subgroups of Members of Two-Parent Families ES-30 

1 . 1 Steps from Income Maintenance to Attendance at Jobs-First GAIN 

Orientation and Random Assignment 15 

3 . 1 Major Components of Gross and Net Costs for AFDC-FGs (in 1 998 Dollars) 63 

3.2 Major Components of Gross and Net Costs for AFDC-Us (in 1998 Dollars) 64 

4. 1 Quarterly Impacts on Earnings and AFDC/TANF Payments for AFDC-FGs 78 

4.2 Relative Contributions of Key Employment and Earnings Effects to the 

Two-Year Impacts on Quarters Employed and Total Earnings for AFDC-FGs 83 

5.1 Employment and AFDC/TANF Status of AFDC-FGs over Two Years 1 1 3 

5.2 Distribution of AFDC-FGs on Measures of Year 2 Income Relative 

to the Poverty Threshold 1 19 

6. 1 Conceptual Model of the Possible Effects of Jobs-First GAIN on Child Outcomes 148 

7.1 Quarterly Impacts on Earnings and AFDC/TANF Payments for AFDC-Us 169 

7.2 Relative Contributions of Key Employment and Earnings Effects to the 

Two-Year Impacts on Employment Duration and Total Earnings for AFDC-Us 172 

7.3 Employment and AFDC/TANF Status at the End of Year 2 for AFDC-Us 176 

7.4 Relative Contributions of Key Employment and Earnings Effects to the 
Two-Year Impacts on Employment Duration and Total Earnings 

for AFDC-U Females 183 

7.5 Relative Contributions of Key Employment and Earnings Effects to the 
Two-Year Impacts on Employment Duration and Total Earnings 

for AFDC-U Males 184 



Preface 



As welfare rolls have gone down in recent years, welfare recipients have become increas- 
ingly concentrated in large urban areas. There, the challenges of reform are great: Unemployment 
rates typically exceed the national average; welfare recipients (many of them people of color and 
recent immigrants) often live far from available jobs and face other barriers to employment, includ- 
ing discrimination in the labor market; and welfare systems are operated by large bureaucracies that 
can be difficult to change. To meet these challenges, program administrators and policymakers 
need reliable information on effective approaches to helping people find employment and reducing 
welfare dependency. 

Over the past decade, studies of welfare programs in Los Angeles County, the most popu- 
lous in the nation, have helped meet this need. Since the late 1980s, administrators of the county’s 
Department of Public Social Services (DPSS) have implemented several different strategies for 
boosting employment and reducing welfare and have, to an unusual extent, sought to have the ef- 
fectiveness of their efforts rigorously evaluated. This commitment to knowledge development has 
created an important legacy for the county and for the nation. 

This report concludes MDRC’s study of an important stage in the evolution of welfare re- 
form in Los Angeles County. In the mid-1990s, DPSS transformed its Greater Avenues for Inde- 
pendence (GAIN) program, which sent most welfare recipients to school to learn basic skills, into 
Jobs-First GAIN, a Work First program that assigned most welfare recipients to job search and at- 
tempted to move welfare recipients as quickly as possible into employment. Jobs-First GAIN’S 
main features included: (1) an unusually intensive program orientation; (2) high-quality job clubs, 
which combined instruction in job-finding skills with activities aimed at boosting participants’ 
self-esteem and motivation to work; (3) job development activities; (4) strong encouragement to 
take entry-level jobs and combine work and welfare in the short term; and (5) relatively tough, 
enforcement-oriented case management. 

DPSS administrators contracted with MDRC to evaluate the program using a particularly 
reliable random assignment design. The evaluation began in 1 996 and included nearly 2 1 ,000 sin- 
gle parents and members of two-parent households. This unusual study was made possible by 
funding from DPSS, the Administration for Children and Families at the U.S. Department of 
Health and Human Services, and the Ford Foundation. 

This is the third and final report from the evaluation. The first described how DPSS re- 
structured its GAIN program and concluded that it is possible to change a large, urban, basic- 
education-focused welfare-to-work program into a work-focused one. The second showed the 
substantial gains in employment and reductions in welfare receipt during the first year after peo- 
ple entered Jobs-First GAIN. The current report finds that Jobs-First GAIN sustained these re- 
sults into a second year, producing employment gains for many types of welfare recipients. It 
also shows that the increase in single mothers’ working did not seem to result in clear gains or 
losses for their children. Finally, the report concludes that the program increased welfare recipi- 
ents’ employment and earnings to a greater extent and was more cost-effective from the stand- 
point of government budgets than the GAIN program that had preceded it. These are notable 
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achievements for a large urban welfare-to-work program. However, at the end of the two-year 
follow-up period, many people were still jobless or employed in jobs that paid relatively little 
and offered few benefits, and there was little change in participants’ total income. These findings 
demonstrate not only that a well-designed and innovative Work First strategy can achieve posi- 
tive results in a large urban area but also that there are no easy answers. 

In April 1998, DPSS replaced Jobs-First GAIN with CalWORKs, California’s welfare-to- 
work program under the TANF provisions of the 1996 federal welfare reform law. The new pro- 
gram retained Jobs-First GAIN’S Work First services and messages but added time limits on wel- 
fare eligibility (although only for adult recipients), somewhat stronger financial incentives to 
work, post-employment services aimed at increasing job retention and advancement, extended 
child care assistance and medical coverage for people who leave welfare for employment, and 
special services for victims of domestic violence and recipients with mental health or substance 
abuse problems. It remains for future studies to determine whether CalWORKs’ more compre- 
hensive approach to promoting self-sufficiency does better than programs like Jobs-First GAIN, 
which focused on helping welfare recipients find a job. 



Judith M. Gueron 
President 
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Executive Summary 



This document summarizes the two-year findings from a large-scale, rigorous evaluation 
of Jobs-First GAIN, a strongly employment-focused mandatory welfare-to-work program. The 
Los Angeles County Department of Public Social Services (DPSS) operated Jobs-First GAIN 
from January 1995 through March 1998. The evaluation, conducted by the Manpower Demon- 
stration Research Corporation (MDRC), has been jointly funded by DPSS, the U.S. Department 
of Health and Human Services, and the Ford Foundation. Los Angeles operates the largest 
county welfare program in the nation, serving more recipients than all states except New York 
and California. The size and diversity of Los Angeles County’s population mean that any success 
achieved by Jobs-First GAIN will have broad significance. 

In a report on the Jobs-First GAIN Evaluation after one year of follow-up (year 1), it was 
concluded that Jobs-First GAIN produced substantial increases in employment and earnings and 
reductions in welfare expenditures relative to what welfare recipients would have achieved had 
they not entered the program. Furthermore, the program produced positive results for many dif- 
ferent types of welfare recipients. The report summarized here examines whether Jobs-First 
GAIN sustained these effects through a second year of follow-up (year 2). It then assesses the 
program’s two-year effects on a wide range of additional outcomes, including (1) employment 
stability and wage growth, (2) income and self-sufficiency, (3) medical coverage, (4) child care 
use, (5) household structure, (6) food insecurity, and (7) children’s academic and behavioral ad- 
justment and safety. The report also examines Jobs-First GAIN’S cost-effectiveness. 

Jobs-First GAIN anticipated the philosophy and goals of the federal Personal Respon- 
sibility and Work Opportunity Reconciliation Act (PRWORA) of 1 996, which replaced Aid to 
Families with Dependent Children (AFDC), the nation’s largest cash welfare program, with 
block grants to the states called Temporary Assistance for Needy Families (TANF). (This type of 
cash assistance is referred to here as AFDC/TANF or welfare.) Jobs-First GAIN emphasized job 
search assistance and imparted a strong pro-work message in an effort to move thousands of wel- 
fare recipients quickly into jobs. Its message and emphasis place Jobs-First GAIN in the category 
of Work First programs, the approach strongly encouraged by PRWORA and followed by most 
current state and local welfare-to-work programs. Most features of Jobs-First GAIN continued 
under Los Angeles County’s TANF program, California Work Opportunity and Responsibility to 
Kids (CalWORKs), which replaced Jobs-First GAIN in April 1998. 

The similarities between Jobs-First GAIN and its successor, CalWORKs, make the find- 
ings of this evaluation especially useful to practitioners and researchers who need reliable infor- 
mation on the effects of TANF-era welfare-to-work initiatives in large urban settings. The differ- 
ences between Jobs-First GAIN and CalWORKs are also important. Like many other TANF-era 
programs, CalWORKs modified the Jobs-First GAIN program model by adding time limits on 
welfare eligibility (although only for adult recipients), somewhat stronger financial incentives to 
work, extended transitional benefits, post-employment services aimed at increasing job retention 
and advancement, and special services for victims of domestic violence and people with mental 
health or substance abuse problems. The Jobs-First GAIN Evaluation therefore tests the effects 
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of CalWORKs’ primary pre-employment strategy (and that of many other TANF-era programs), 
but without time limits and post-employment and special services and with smaller financial in- 
centives to keep working. Jobs-First GAIN’S effects on employment, earnings, welfare depend- 
ency, and income will serve as a benchmark for gauging the effects of CalWORKs’ (and other 
TANF programs’) more comprehensive approach to promoting self-sufficiency. 

Jobs-First GAIN, which encouraged welfare recipients to start working as soon as possible, 
replaced Los Angeles GAIN, the county’s previous GAIN (Greater Avenues for Independence) 
program, which encouraged welfare recipients to return to school to improve their basic skills. 
Launched in 1988, Los Angeles GAIN assigned most of its enrollees, all of whom were long-term 
welfare recipients, to adult basic education (remedial English and math), General Educational De- 
velopment (GED) test preparation, or English as a Second Language classes. Relatively few enroll- 
ees were assigned to job search activities. Evidence from several sources, including an evaluation 
of the program by MDRC, convinced DPSS’s top administrators that Los Angeles GAIN’S basic 
education approach, despite being costly, helped relatively few people find employment. The ad- 
ministrators resolved that adopting a Work First approach would benefit welfare recipients finan- 
cially and save taxpayer dollars. The Jobs-First GAIN Evaluation tests this premise by comparing 
Jobs-First GAIN’S effects with those of the county’s earlier GAIN program. The findings from 
this comparison are important because administrators in many other localities made similar 
changes to their welfare-to-work programs during the 1990s. 

Central to the evaluation is an experimental design based on random assignment. From 
April 1 through September 11, 1996, nearly 21,000 single parents (AFDC-FGs, or Family Group 
cases) and members of two-parent households (AFDC-Us, or Unemployed Parent cases) who 
showed up at a Jobs-First GAIN office for their scheduled orientation were randomly assigned 
either to the experimental group or to the control group. Experimental group members had ac- 
cess to Jobs-First GAIN’S program services and exposure to its Work First message. They were 
also subject to the program’s mandatory participation requirements and could incur a sanction — 
a reduction in their welfare grant — for noncompliance. Control group members were precluded 
from receiving Jobs-First GAIN services until October 1998, the end of the follow-up period for 
the evaluation, but remained eligible to receive welfare and Food Stamps. Control group mem- 
bers could also seek out other services in the community and receive child care assistance from 
DPSS for employment-related programs in which they enrolled on their own initiative. Finally, 
both experimental and control group members were covered by California’s Work Pays rules for 
calculating welfare grants (described in Section II). Work Pays allowed most welfare recipients 
who found a job to continue receiving welfare benefits and to retain their eligibility for Medicaid. 

I. Overview of the Findings 

• Los Angeles County successfully transformed its previous, basic- 
education-focused welfare-to-work program into a Work First program. 

This change was accomplished without a major reorganization of the 
county’s welfare agency and before passage of federal welfare legislation. 

The implementation of Jobs-First GAIN succeeded for several reasons. Most 
importantly, top administrators within DPSS were committed to refashioning 




ES-2 



17 



the welfare-to-work program’s services and message into a Work First model 
and had the administrative authority to carry out these changes. In addition, 
many of DPSS’s supervisors and staff supported and participated in this proc- 
ess. Further, DPSS developed strong partnerships with outside service provid- 
ers, in particular, with the Los Angeles County Office of Education, which de- 
signed and operated Jobs-First GAIN’S motivational orientation sessions and 
job clubs. 

A. Impacts for Single Parents (AFDC-FGs) 

• Jobs-First GAIN led to substantial two-year increases in employment 
(that is, in the proportion of people ever employed in the two years of fol- 
low-up) and in earnings. During the two-year follow-up period, Jobs-First 
GAIN increased employment by 1 0 percentage points and earnings by an av- 
erage of $1,627 (26 percent) relative to control group levels. These increases 
compare favorably with those achieved by several previously evaluated Work 
First programs and are particularly impressive for a welfare-to-work program 
in a large urban area. 

• The program produced modest reductions in welfare and Food Stamp re- 
ceipt (that is, the proportion of people receiving each of these benefits) 
and large reductions in welfare and Food Stamp payments (that is, actual 
expenditures for each type of assistance). At the end of year 2, welfare re- 
ceipt in the experimental group was 62 percent, 5 percentage points below the 
control group level. Jobs-First GAIN reduced the average two-year welfare 
outlay by $972 per experimental group member, or 10 percent, relative to the 
control group average. Jobs-First GAIN produced similar reductions in Food 
Stamp receipt and payments. 

• Jobs-First GAIN produced a small net increase in total income in year 2; 
the results appear more positive for the last month of the year. Although 
experimental group members earned more and received more in Earned In- 
come Tax Credit (EITC) payments than control group members, these gains in 
income were almost exactly counterbalanced by reductions in income from 
lower welfare and Food Stamp payments and by higher payroll taxes. As a re- 
sult, Jobs-First GAIN produced only a small (2 percent) increase in income 
from these sources in year 2. An estimate of monthly income at the end of 
year 2 based on survey data, however, showed a larger increase of about 9 
percent. 

• The program did not affect whether people had medical coverage, but did 
produce a shift from public to private insurers. About 90 percent of people 
in the control group reported receiving medical coverage for themselves and 
their children from Medi-Cal (California’s Medicaid program), from their em- 
ployer, or from another source at the end of year 2. Experimental group mem- 
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bers reported similar levels of coverage, but a larger proportion of them relied 
on medical insurance from employers. 

• There were few statistically significant impacts on indicators of health 
and well-being. About the same percentage of experimental and control group 
members reported having a health, emotional, or family problem that made it 
difficult for them to work. Similarly, no statistically significant differences 
were found in reported housing status or neighborhood quality and safety. For 
reasons that are unclear, 12 percent of experimental group members, com- 
pared with only 6 percent of control group members, reported that they had 
not eaten for a whole day at some point during the follow-up period because 
they lacked money to feed everyone in their family. 

• Jobs-First GAIN increased the use of child care and the incidence of child 
care problems that affected employment Jobs-First GAIN’S large effects on 
full-time employment resulted in an equally large (13 percentage point) in- 
crease in the use of child care. Roughly half of the increase was for structured 
child care arrangements that required payment for services, and the other half 
was for less formal, unpaid arrangements. Nearly all sample members who 
used paid care covered the expenses out of pocket; very few reported submit- 
ting records of expenses to DPSS for reimbursement or receiving transitional 
child care or other government subsidies. Much of the increased use of child 
care while parents were working was of child care that was considered unreli- 
able — that is, that caused experimental group members to miss or be late for 
work at least once in a typical month of employment. This problem was most 
common among families with preschool-aged children. 

• The program had no systematic effects on the child outcomes examined. 
Jobs-First GAIN produced little or no change in the selected aspects of chil- 
dren’s academic achievement and schooling, behavioral and emotional ad- 
justment, and safety that were studied. Separate analyses for boys and girls 
under 1 8 and for school-aged children (boys and girls together) showed simi- 
lar results. Jobs-First GAIN increased the incidence of some academic and be- 
havioral problems among a small group of preschool-aged children. Only ten- 
tative conclusions about child outcomes can be drawn from the evaluation, 
however, because tests of school readiness and cognitive development com- 
monly used in research on young children were not included. 

• Jobs-First GAIN achieved larger employment and earnings gains than 
the county’s previous, basic-education-focused program. A comparison of 
impacts for welfare recipients in Jobs-First GAIN with those for recipients 
with similar background characteristics in Los Angeles GAIN showed Jobs- 
First GAIN to have increased two-year earnings by more than $1,700, com- 
pared with a two-year impact of $200 for the earlier GAIN program. Jobs- 
First GAIN and its predecessor reduced average welfare expenditures by a 
similar amount, however: about $1,000 per experimental group member. 



ERIC 



ES-4 



19 



• Many different types of welfare recipients benefited from Jobs-First 
GAIN. Such consistency in findings is unusual and impressive. The pro- 
gram increased earnings and reduced welfare payments for recipients in the 
central city and outer regions of Los Angeles County, for different ra- 
cial/ethnic groups (including single parents with a limited command of Eng- 
lish), and for recipients with either many or few serious barriers to employ- 
ment. 

• Jobs-First GAIN’S costs were more than offset by savings in welfare 
payments and other types of assistance. Like other Work First programs 
previously evaluated by MDRC, Jobs-First GAIN led to only modest increases 
in expenditures for employment-related services. Estimated over the five-year 
period starting at random assignment, and based on both observed effects (in 
years 1-2) and projected effects (in years 3-5), the cost of the program is ex- 
pected to be more than compensated for by savings in welfare, Food Stamps, 
and Medi-Cal and associated administrative costs and by small increases in 
tax revenues. 

B. Impacts for Two-Parent Families (AFDC-Us) 

• The program’s two-year impacts on earnings and welfare expenditures 
were somewhat larger for members of two-parent families than for single 
parents. The program boosted employment levels for members of two-parent 
families by 1 0 percentage points and increased their two-year earnings by an 
average of $2,050, or 31 percent, relative to control group levels. Jobs-First 
GAIN reduced the average two-year welfare outlay by $1,429, or 12 percent, 
and produced similar reductions in Food Stamp payments. 

• The program positively affected many subgroups of two-parent families, 
but not as consistently as it did single-parent subgroups. Jobs-First GAIN 
increased two-year earnings for both men and women in two-parent families, 
although the average earnings gain for men ($2,645) was nearly twice as large 
as that for women ($1,486). Whereas non-Hispanic whites did not experience 
a two-year earnings increase, Hispanics achieved an unusually large increase 
of $3,824, and Asians experienced a moderate gain of $1,429. The latter two 
findings are impressive because half of Hispanics and almost three-fourths of 
Asians lacked English proficiency at random assignment. Earnings increases 
were also larger for sample members who entered the program without a high 
school diploma or GED certificate than for graduates. 



II. Key Features of Jobs-First GAIN 

In response to the passage of the federal welfare reform legislation (PRWORA) in 1 996, 
most states and localities are implementing some kind of Work First approach, which entails of- 
fering job search assistance as a primary service (possibly followed by work-focused education and 
training) and encouraging welfare recipients to start working as soon as possible. Los Angeles’s 
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version — Jobs-First GAIN, which was put in place prior to the federal law — had a number of 
features that together represent a strong commitment to a Work First philosophy. As noted 
above, most of these features have continued under CalWORKs (see Table 1). 

• Communicating a strong Work First message. DPSS administrators stated 
clearly that the goal of Jobs-First GAIN was to move people into employment 
as rapidly as possible. This philosophy was communicated to program 
enrollees through written handouts and group presentations and in individual 
meetings with program staff. 

• Warning enrollees that time-limited welfare is coming and urging them to 
get a job right away to preserve their eligibility for assistance. Even before 
the passage of PRWORA in August 1996, Jobs-First GAIN staff were informing 
new enrollees that the federal and state governments would limit welfare eligi- 
bility, possibly to two years, and were encouraging them to find work in order to 
avoid the expected cuts in welfare. As one agency flier put it: 

Everyone will be expected to work. These changes could occur as early 
as 1996. It is critical that you prepare now for these social changes. Work 
experience is the best training. Remember: “WORK IS IN, WELFARE 
IS OUT.” 

This message was repeated during program activities such as job club and in in- 
dividual meetings with program staff 

• Operating an unusually intensive program orientation. All new enrollees 
attended a six-hour group orientation session, followed by a one-on-one ap- 
praisal meeting with a case manager during their first day in the program. In 
contrast, most other welfare-to-work programs, including some that share the 
Work First philosophy, run much shorter orientations. Further, whereas in 
these other programs staff use most of the orientation to collect background 
information on new enrollees and assign them to their first employment- 
related activity, Jobs-First GAIN staff devoted most of the orientation to com- 
municating Jobs-First GAIN’S message to new enrollees and increasing their 
self-esteem — particularly with regard to their ability to find work. 

• Providing high-quality job search assistance. Well-trained staff from the 
Los Angeles County Office of Education ran job search services at 1 5 Job 
Centers around the county, and — along with program staff — monitored par- 
ticipants’ progress. Jobs-First GAIN’S job clubs provided instruction in many 
of the skills needed to obtain employment, including finding job openings, 
writing a resume and filling out a job application, and being interviewed. Job 
club participants then conducted up to two weeks of supervised job search 
with the aid of agency phone banks, job listings, and program staff. These 
characteristics are typical of job clubs in many other welfare-to-work pro- 
grams. Jobs-First GAIN’S job clubs, however, also featured a strong motiva- 
tional component. Their message and specially developed curriculum were 
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Table 1 



Key Features of Welfare-to-Work Programs in Los Angeles 

Los Angeles GAIN (1988-1993; transition to Jobs-First GAIN, 1993-1995) 

• Served long-term welfare recipients. Gave priority to those who had been on assistance the longest. 

• Exempted single parents whose youngest child was under 3. In 1989-1990, gave priority to single parents 
whose youngest child was over 6. 

• Assigned basic education as a first activity. By mid- 1994, assigned job club as a first activity. 

• Strictly enforced the participation requirements but made limited use of financial sanctions. 

Jobs-First GAIN (1995-1998) 

• Served mostly long-term welfare recipients (with 3-5 years of receipt) and some short-term recipients and 
newly approved applicants. 

• Exempted single parents whose youngest child was under 3. 

• Imparted a strong Work First message. 

• Stressed the financial benefits of combining work and welfare in the short term. 

• Provided an unusually intensive, motivational program orientation. 

• Assigned job club as a first activity. Taught job-finding skills and stressed motivation- and self-esteem- 
building. 

• Provided job development services. 

• Strictly enforced the participation requirements and frequently used financial sanctions. 

Cal WORKs (1998-present) 

• Serves most welfare recipients and recent applicants; exempts single parents whose youngest child is under 1. 

• Continues Jobs-First GAIN pre-employment services, messages, and enforcement policies. 

• Puts time limits on welfare eligibility for adults. 

• Provides special services for people with substance abuse or mental health problems and for victims of 
domestic violence. 

• Offers the following post-employment services: extended case management; counseling, mentoring, and 
treatment; and education and training. 

• Provides extended transitional child care and Medi-Cal benefits. 
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upbeat, stressing how work can lift self-esteem and how a low-paying first job 
can lead to a better one in the future. In addition, Jobs-First GAIN staff 
aggressively developed relationships with local employers and matched 
enrollees to specific job openings. These job development efforts went well 
beyond what is traditionally offered in job search activities. 

Jobs-First GAIN offered short-term basic education and vocational train- 
ing classes, but assigned few enrollees to these activities. The program also 
made limited use of unpaid work experience jobs. 

• Using job development activities to support enrollees’ job search efforts. 
Each Jobs-First GAIN office had job developers who cultivated relationships 
with local employers and created lists of job openings. Job developers then 
tried to match enrollees to available job openings, based on enrollees’ prior 
experience and interests. Job developers began working with enrollees during 
orientation and appraisal and continued assisting their job search efforts dur- 
ing job club and other stages of program participation. Job developers also ar- 
ranged and hosted job fairs for enrollees — small, weekly fairs with one or 
two employers and larger, quarterly fairs with numerous employers. One pro- 
gram office even experimented with having its job developers work on a one- 
on-one basis with program enrollees who had received a financial sanction for 
not complying with program requirements. 

• Demonstrating that work pays. As noted above, California’s Work Pays 
rules for calculating welfare grants allowed many recipients to combine work 
and welfare. Using waivers granted by the U.S. Department of Health and 
Human Services, Work Pays increased, above national standards, the amount 
of earnings that the welfare department “disregarded” (did not count) when 
calculating welfare grants. As a result, most welfare recipients who combined 
work and welfare could receive hundreds of dollars per month in income 
above what they would have received in welfare alone. Work Pays became 
part of Jobs-First GAIN’S strategy for convincing people to find employment 
as quickly as possible even if available jobs paid little. Jobs-First GAIN staff 
made a concerted effort to explain the financial benefits of Work Pays to new 
enrollees by walking them through several examples of grant calculations dur- 
ing motivational sessions at program orientation and by repeating this mes- 
sage during job club and other employment-related activities. 

Both experimental and control group members were covered by Califor- 
nia’s Work Pays rules. Control group members may have been motivated by 
these rules to look for work on their own initiative or to increase their hours of 
work. However, it is likely that fewer control than experimental group mem- 
bers knew about Work Pays because they did not attend orientation or job club 
and did not meet with Jobs-First GAIN case managers. 
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• Running a relatively tough, enforcement-oriented program. Jobs-First 
GAIN case managers made frequent use of the program’s formal enforcement 
procedures, including threats to reduce welfare grants, to encourage enrollees 
to participate in program activities or show good cause why they could not. As 
discussed in the full report, the vast majority of program enrollees received at 
least one warning that they were out of compliance with program rules. About 
30 percent of single parents and a quarter of adults in two-parent families in- 
curred a sanction for noncompliance; a sanction entailed dropping the recipi- 
ent (but not the recipient’s children) from the grant. Program administrators 
intended this high-enforcement case management approach and the strong 
pro-employment message to complement the program’s high-quality, motiva- 
tional job clubs. Together, these components of Jobs-First GAIN encouraged 
enrollees to find work quickly and discouraged them from spending a long 
time in the program. 



III. The Research Sample and Program Environment 

The research sample for the Jobs-First GAIN Evaluation includes 1 5,683 single parents 
(AFDC-FGs) and 5,048 members of two-parent families (AFDC-Us). During the evaluation, 
DPSS followed the eligibility criteria written into the federal Family Support Act (FSA) of 1988, 
which preceded PRWORA, in determining which recipients had to enroll in Jobs-First GAIN. 
According to the FSA, any single-parent welfare recipient whose youngest child was 3 or over 
and who did not meet certain exemption criteria was mandated to participate in a welfare-to- 
work program. Grounds for exemption included having a disabling illness, being employed full 
time (30 hours or more per week), living in a remote area that made program activities inaccessi- 
ble, or being in at least the second trimester of pregnancy. These criteria also pertained to AFDC- 
U welfare recipients, except that AFDC-U parents of children under 3 were also required to en- 
roll in a welfare-to-work program. Exercising an option given to states and localities under the 
FSA, DPSS also required both parents on an AFDC-U case to enroll in Jobs-First GAIN. 

Because DPSS did not have the resources to serve all welfare recipients mandated to par- 
ticipate, prior to the evaluation it reserved nearly all places in Jobs-First GAIN for people identi- 
fied by the FSA as being at the greatest risk of remaining on welfare for a long time. DPSS gave 
highest priority to serving those who had received welfare continuously for at least three years. 
To enable the evaluation to determine the effect of the Jobs-First GAIN approach on a broad 
cross section of the welfare caseload and on different types of welfare recipients, DPSS adminis- 
trators later implemented a complex procedure for selecting new enrollees. The resulting sample, 
which included nearly everyone who came into the program between April and early September 
1996, appears to reflect, in very broad terms, the diversity of the Jobs-First GAIN-mandatory 
caseload. The sample differed from the full Jobs-First GAIN-mandatory caseload principally in 
having a substantially smaller percentage of people going through a very long spell — of at least 
five years — on welfare and in excluding teen parents and a few other groups. 

The sample includes welfare recipients who inhabit the inner-city neighborhoods of Los 
Angeles as well as recipients in the outlying suburbs. The sample is also diverse with respect to 
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race and ethnicity, age, family size, and several indicators of relative disadvantage in the labor 
market. Among AFDC-FG sample members, Hispanics formed the largest ethnic group (45 per- 
cent), followed by African-Americans (about 31 percent), non-Hispanic whites (17 percent), and 
Asians (6 percent). A little more than half of the AFDC-FGs had at least one preschool-aged 
child (under the age of 6), for whom child care would be needed. Nearly 20 percent of AFDC-U 
sample members were Asians (primarily Vietnamese and Cambodian immigrants and refugees), 
and about half had limited English proficiency. Relative to the AFDC-FG group, the AFDC-U 
group included a larger percentage of non-Hispanic whites (many of them recent immigrants 
from Armenia) and a much smaller percentage of African-Americans. Further, the AFDC-U 
sample members had, on average, more children than did the AFDC-FG sample members (2.4 
versus 2.0). 

A large majority of AFDC-FG and AFDC-U sample members faced one or more serious 
barriers to employment at the time of random assignment: More than half of each group had not 
graduated from high school or received a GED certificate; about 60 percent had not worked for 
pay in the prior three years; and about 70 percent had received welfare for at least two years cu- 
mulatively. Other members of the research sample faced fewer barriers to employment: About 30 
percent of both AFDC-FGs and AFDC-Us were newly approved applicants for assistance or had 
received assistance for less than two years, and more than a quarter of each group had worked for 
pay in the year prior to random assignment. 

A. Subgroups for Analysis 

A key task of the Jobs-First GAIN Evaluation is to analyze whether Los Angeles 
County’s Work First approach benefited many types of recipients or primarily particular sub- 
groups. Key subgroups for analysis include: 

1 . Inhabitants of different geographic areas of the county 

2. Members of different racial/ethnic groups 

3. People who entered the program with a high school diploma or a GED certifi- 
cate and nongraduates 

4. Short- and long-term welfare recipients 

5. People with or without a recent work history 

6. People with multiple barriers to employment: no high school diploma or GED 
certificate, no recent work history, and long-term welfare receipt 

7. Among AFDC-Us, men and women (A large majority of AFDC-FGs were 
women.) 

B. Additional Background Information 

Labor market conditions in Los Angeles County improved during the evaluation period: 
Employment levels rose, and unemployment declined. Still, the county’s unemployment rate is 
higher than the national average and varies considerably by region. For example, unemployment 
rates in South-Central and East Los Angeles — communities where more than 90 percent of the 
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residents are either African-American or Hispanic — still hover around more than 9 percent, 3 
percentage points above the county average. 

The county’s AFDC/TANF caseload numbers followed the trends in employment figures. 
In July 1996, Los Angeles County had about 306,000 cases; two years later, the number declined 
to 245,000. California reduced grant levels by nearly 7 percent during these years (for instance, 
from $607 to $565 for a family of three), although the state’s welfare grant levels remained well 
above the national average. 



IV. Program Implementation and Participation 

• Jobs-First GAIN exposed all enrollees to a strong Work First message 
and increased their use of job search services. 

All experimental group members attended a six-hour informational and motivational 
meeting at orientation during which program staff strongly communicated the program’s Work 
First message. Fewer than half of experimental group members (42 percent of AFDC-FGs and 34 
percent of AFDC-Us) subsequently participated in a Jobs-First GAIN activity for at least one 
day. Nearly all who participated in Jobs-First GAIN activities attended job club only, and most 
took part in only one three-week job club session. Jobs-First GAIN case managers assigned very 
few experimental group members to education and training activities and rarely approved re- 
quests to continue participation in education and training activities that predated the program. 
(Approval gave the enrollee credit for participating in a Jobs-First GAIN activity and made her 
eligible for child care and other assistance.) Nonetheless, about 40 percent of experimental group 
members who answered the Two-Year Client Survey, which was administered at the end of year 
2 to 746 single parents in the research sample, reported that they attended an education or train- 
ing activity on their own initiative after random assignment. About half of these people, or about 
20 percent of experimental group members who responded to the survey, also attended job club 
or another Jobs-First GAIN activity, and the other half participated in activities only outside 
Jobs-First GAIN. 

In all, about 62 percent of experimental group members participated in some type of em- 
ployment-related activity in the follow-up period other than the program orientation (see Figure 
1 ; AFDC-Us were not surveyed). About 44 percent of control group members also participated in 
an employment-related activity outside Jobs-First GAIN, typically vocational training or post- 
secondary education. The difference in participation rate between the experimental and control 
groups, 1 8 percentage points, represents Jobs-First GAIN’S impact on participation in activities, 
which is relatively modest. However, the program also produced a large (31 percentage point) 
gain in use of job search services, plus a small (5 percentage point) gain in participation in un- 
paid work experience jobs. 

• Jobs-First GAIN case managers made extensive use of the program’s en- 
forcement procedures and imposed financial sanctions for noncompliance 
relatively frequently. 

Jobs-First GAIN staff initiated formal enforcement proceedings for about 80 percent of 
both AFDC-FGs and AFDC-Us during the two-year follow-up period. Grounds for commencing 
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Figure 1 

Two-Year Impacts on Participation in Employment-Related 
Activities for Single Parents 
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this conciliation process (as DPSS termed it) included nonattendance at an assigned activity or 
scheduled meeting with Jobs-First GAIN staff or refusal to accept an assignment to job club. 

If after repeated reminders that participation was mandatory an enrollee did not provide 
DPSS staff with an acceptable reason for nonattendance at assigned activities, a sanction (a re- 
duction in welfare benefits) was imposed. About 30 percent of AFDC-FGs and 23 percent of 
AFDC-Us incurred a sanction during follow-up. These rates exceed those for several other em- 
ployment-focused welfare- to- work programs evaluated by MDRC and are much higher than 
those for the Los Angeles GAIN program (5 percent). 



V. Program Costs 

• As is typical of Work First programs, the net cost of Jobs-First GAIN was 
relatively low. 

The full report presents a rough estimate of the gross cost per experimental group mem- 
ber of providing employment-related services, case management, and supportive service pay- 
ments. (All dollar amounts are expressed in 1998 dollars.) The gross cost includes the cost to 
DPSS and outside providers of operating Jobs-First GAIN activities, plus the cost of operating 
activities that experimental group members attended outside Jobs-First GAIN. The gross cost 
does not include the cost to DPSS of authorizing and processing welfare checks. The two-year 
gross cost per AFDC-FG experimental group member was about $4,300. This average is rela- 
tively high, but reflects experimental group members’ extensive use of education and training 
services outside Jobs-First GAIN. DPSS paid about $1,800, or 40 percent, of the gross cost, pri- 
marily to operate the program’s motivational orientation session and job clubs and to perform 
case management. A large percentage of AFDC-FG control group members attended education 
and training activities on their own initiative. The gross cost per control group member is there- 
fore relatively high as well, averaging nearly $2,900. The average experimental-control differ- 
ence, or the net cost of the program, was thus around $1,400 (that is, $4,300 - $2,900) per ex- 
perimental group member. Jobs-First GAIN’S net cost is close to those of several other Work 
First programs evaluated by MDRC, the net costs of which ranged from about $1,200 to $2,500. 
Estimates of the gross and net costs of Jobs-First GAIN for AFDC-Us are less precise because 
MDRC did not collect information on experimental and control group members’ participation in 
employment-related activities outside Jobs-First GAIN. On the basis of a comparison between 
AFDC-FG and AFDC-U experimental group members with respect to participation patterns 
within Jobs-First GAIN, it was assumed that AFDC-Us in both research groups participated in 
these self-initiated activities less often than AFDC-FGs. The full report estimates the gross cost 
of the program per AFDC-U experimental group member to be about $2,500 and its net cost to 
be around $1,200. 



VI. Impacts for Single Mothers (AFDC-FGs) 

Experimental designs based on random assignment typically provide the most accurate 
and reliable findings on the effects of welfare-to-work programs. Because people are assigned at 
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random to the experimental or control group, the two groups do not differ systematically with 
respect to either measured characteristics (such as length of time on welfare) or unmeasured 
characteristics (such as strength of motivation to get a job). Members of the two groups also face 
the same labor market conditions. The outcomes for control group members represent what 
would have happened to welfare recipients in the absence of the program. Thus, any subsequent 
differences found between the two groups can be attributed with confidence to the combination 
of program services, messages, and participation mandates that only experimental group mem- 
bers experienced. These differences are known as program impacts. Unless otherwise noted, all 
are statistically significant, that is, have a more than 90 percent chance of arising from the pro- 
gram rather than by chance. 

• Jobs-First GAIN increased employment and earnings during the two- 
year follow-up period. 

About 67 percent of experimental group members worked for pay at some point during 
the follow-up period, compared with 58 percent of control group members (see Table 2). As is 
typical of Work First programs, Jobs-First GAIN had a larger impact on employment in year 1 . 
Its impact shrank somewhat in the following year but remained substantial, averaging between 6 
and 7 percentage points in each quarter of year 2. Employment gains will almost certainly con- 
tinue into year 3. 

During the two years of follow-up, control group members earned an average of $6,385, 
whereas experimental group members earned an average of $8,012 — a gain of $1,627, or 26 
percent. (Both averages include zeros for those who did not work for pay in year 1 or year 2.) As 
would be expected of a Work First program, Jobs-First GAIN increased earnings primarily by 
helping recipients who would not have found jobs on their own find work and by helping recipi- 
ents who would have eventually found employment start working sooner. An analysis comparing 
only those people in the experimental and the control groups who found jobs shows that Jobs- 
First GAIN led to only small increases in the number of quarters of employment and in average 
earnings per quarter. 

• Earnings gains for AFDC-FGs grew from $759 in year 1 to $869 in year 2. 

The program increased full-time employment and employment with 
fringe benefits at the end of year 2. 

Quarterly earnings gains reached their highest level ($237 per experimental group mem- 
ber) at the end of year 2 and will almost surely continue into year 3. Sample members’ responses 
to survey questions about the characteristics of the jobs they held at the end of year 2 underscore 
these positive trends. Jobs-First GAIN produced a large (1 1 percentage point) gain in full-time 
employment (of 30 hours per week or more) at the end of year 2. In addition, a higher percentage 
of employed experimental than control group members reported receiving paid vacation or medi- 
cal coverage from their employer at the end of year 2 (see Table 3). Despite their earnings gain, 
relatively few experimental group members were working at jobs that provided fringe benefits at 
the end of year 2. For instance, only 14 percent of experimental group members Oust under one- 
third of those who were employed) were working at jobs with full-time hours and medical cover- 
age, an important indicator of successful employment. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 2 

Two-Year Impacts on Employment, Earnings, Welfare, and Food Stamps 
. for Single Parents 





Experimental 


Control 


Difference 


Percentage 


Outcome 


Group 


Group 


(Impact) 


Change (%) 



Over the two-year follow-up period 



Ever employed (%) 


67.2 


57.6 


9.6 *** 


16.6 


Average total earnings ($) 


8,012 


6,385 


1,627 *** 


25.5 


Average total AFDC/TANF payments received ($) 


9,092 


10,064 


-972 *** 


-9.7 


Average total Food Stamps received ($) 


3,525 


3,891 


-366 *** 


-9.4 


In the last quarter of follow-up (%) 


Employed 


44.9 


38.4 


6.5 *** 


17.0 


Received AFDC/TANF 


61.5 


66.2 


-4.6 *** 


-7.0 


Received Food Stamps 


60.3 


64.5 


-4.2 *** 


-6.5 


Sample size (total = 15,683) 


11,521 


4,162 







SOURCE: MDRC calculations from administrative records. 

NOTES: "Percentage change" equals 100 times "difference" divided by "control group." 

Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between outcomes for the experimental and control groups. 
Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 3 

Impacts on Job Characteristics at the End of Year 2 for Single Parents 



Outcome 


Experimental 

Group 


Control 

Group 


Difference 

(Impact) 


Percentage 
Change (%) 


Employed (%) 


46.9 


37.9 


9.0 ** 


23.8 


With full-time hours 


37.8 


26.9 


10.9 *** 


40.4 


With medical coverage 


14.8 


9.3 


5.6 ** 


60.4 


With paid sick leave 


18.0 


14.4 


3.5 


24.3 


With paid vacation 


23.4 


17.1 


6.3 ** 


36.9 


For those employed at interview 










Hours worked per week 


35.7 


32.7 


3.0 


9.3 


Hourly pay ($) 


7.90 


7.73 


0.17 


2.3 


Weekly pay ($) 


283 


248 


35 


13.9 



SOURCE: MDRC calculations from the Two-Year Client Survey. 

NOTES: ’’Percentage change" equals 100 times "difference” divided by "control group." 

Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between outcomes for the experimental and control 
groups. Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 

The italicized estimates pertain only to sample members who were employed at the time of interview. 
Therefore, the italicized differences between the experimental and control groups are not true experimental 
comparisons. 
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• Jobs-First GAIN reduced welfare and Food Stamp expenditures and re- 
ceipt of these benefits in the two-year follow-up period. 

Over two years, experimental group members received an average of $972, or 1 0 per- 
cent, less in welfare payments than control group members (see Table 2). The percentage re- 
ductions in welfare payments grew over the course of follow-up, and will almost certainly con- 
tinue into year 3. Although most of the AFDC/TANF savings resulted from reductions in the 
number of months during which people received welfare, a substantial proportion of the sav- 
ings stemmed from lower welfare payments in months when people were still receiving wel- 
fare. California’s Work Pays financial incentives (which encouraged people to combine work 
and welfare in the short term) and Jobs-First GAIN’S relatively high sanction rate most likely 
contributed to this outcome. Two years after random assignment, 66 percent of control group 
members were still on welfare. Jobs-First GAIN reduced this proportion to 62 percent, an im- 
pact of 5 percentage points (rounded). The program also produced two-year reductions in Food 
Stamp receipt and expenditures that were similar in magnitude to the reductions in 
AFDC/TANF expenditures. 

• Many experimental group members combined work and welfare. At the 
end of year 2, the increase in the percentage of people working and off 
welfare was small. 

Figure 2 illustrates how Jobs-First GAIN affected self-sufficiency by breaking down the 
experimental and control groups into four categories based on their employment and welfare 
status at the end of years 1 and 2. As shown, Jobs-First GAIN reduced the proportion of sample 
members in the most dependent group — those who were jobless and on welfare — by 8 per- 
centage points, from 45 percent to 37 percent, at the end of year 2. The figure also indicates that 
the proportion of experimental group members who were working and off welfare increased over 
time (20 percent at the end of year 2, compared with 1 1 percent at the end of year 1). Still, at the 
end of year 2, most employed experimental group members were combining work and welfare, 
and Jobs-First GAIN only slightly increased the percentage of recipients employed and off cash 
assistance. California’s relatively high welfare grants and Work Pays earnings disregards helped 
produce these results. The earnings of employed experimental group members reduced their wel- 
fare grant amounts, but usually did not render them ineligible for assistance. 

• Jobs-First GAIN led to a small increase in total income from earnings 
(minus payroll taxes), estimated EITC payments, AFDC/TANF, and Food 
Stamps in year 2. The impact on total income appears to have grown over 
time. 

Jobs-First GAIN led to the replacement of welfare dollars with dollars from earnings. In 
year 2, the program increased total yearly income from earnings (minus payroll taxes), estimated 
EITC payments, AFDC/TANF, and Food Stamps by only $206, or 2 percent. 

An alternative way to assess whether Jobs-First GAIN affected income is to compare the 
proportions of experimental and control group members whose income from these sources ex- 
ceeded the federal poverty threshold. (This calculation of income differs from that used to define 
the poverty threshold because it includes Food Stamps and excludes other income sources.) The 
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Los Angeles Jobs-First GAIN Evaluation 



Figure 2 

Employment and Welfare Status 
at the End of Years 1 and 2 for Single Parents 
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program produced mixed effects on this measure. About 29 percent of experimental group mem- 
bers received income that put them above the poverty threshold in year 2 compared with 24 per- 
cent in the control group. AFDC/TANF and Food Stamps remained important sources of income 
for many of these more advantaged sample members. Only about 13 percent of experimental 
group members overall were able to stay above the poverty threshold on earnings alone. Jobs- 
First GAIN also increased the proportion of people with very low incomes (defined as receiving 
income below 50 percent of the poverty threshold) by 3 percentage points. (None of the findings 
with respect to the poverty threshold is shown.) 

Another estimate of total income in the last month of year 2, calculated from survey re- 
sponses and administrative data, shows Jobs-First GAIN’S effect to be larger and more positive. 
This estimate includes child support payments, Supplemental Security Income and disability 
benefits, Social Security and pension benefits, and any other reported income. By this measure, 
Jobs-First GAIN led to an average increase in total income of $86, or 9 percent of control group 
members’ average income in the last month of follow-up, which was $1,001. The program also 
had a large effect on the proportion of people who received income in the final month of follow- 
up that put them above the poverty threshold, increasing this proportion by 1 0 percentage points 
relative to the control group level of 32 percent. 

• Jobs-First GAIN did not affect medical coverage or use of other noncash 
benefits. 

At random assignment, all sample members received welfare benefits and medical cover- 
age through California’s Medi-Cal program. Jobs-First GAIN did not affect the proportion of 
people with medical coverage at the end of year 2. About 92 percent of experimental group 
members in the survey reported receiving coverage for themselves from Medi-Cal, from their 
employer, or from another source — just 1 percentage point below the control group level (the 
difference was not statistically significant). Coverage levels for both respondents and their chil- 
dren were similar in the two research groups and slightly lower than adult coverage levels 
(around 90 percent). Despite Jobs-First GAIN’S employment effect, the relatively high propor- 
tion of respondents who combined work and welfare helped keep Medi-Cal coverage levels rela- 
tively high. In addition, a higher proportion of experimental than control group members re- 
ceived medical coverage from their employers. Only about 3 percent of sample members in each 
research group received Transitional Medi-Cal, which provided one year of extended coverage to 
former welfare recipients who earned too much to remain on welfare. (CalWORKs provides two 
years of extended coverage.) Jobs-First GAIN did not affect the levels of receipt of other types of 
noncash assistance (aside from Food Stamps), such as federally subsidized school lunches for 
children, public housing, government rent subsidies, and energy assistance. 

• For reasons that are unclear, experimental group members reported a 
higher incidence of food insecurity than control group members. 

As noted earlier, Jobs-First GAIN increased total income by a small amount in year 2, al- 
though income for most experimental group members remained below the poverty threshold. Re- 
spondents to the Two-Year Client Survey provided additional information about their problems 
in providing for their families on a limited income. A little more than half (53 percent) of ex- 
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perimental group respondents indicated that they had experienced difficulty obtaining adequate 
and nutritious food owing to lack of money at some point in year 2. This level of food insecurity 
exceeds the national average for U.S. households with incomes below the poverty threshold. Fur- 
thermore, about 19 percent of experimental group members reported experiencing a more severe 
type of food insecurity that involved skipping meals, compared with 13 percent in the control 
group. It is not clear why Jobs-First GAIN produced this negative effect. Jobs-First GAIN did 
not have any other statistically significant effect on indicators of health and well-being. 



VII. Impacts on Child Care, Home Environment, and Child Outcomes 
for Children of Single Mothers 

This section estimates Jobs-First GAIN’S impacts on certain indicators of children’s 
safety and cognitive, social, and behavioral development. It presents results for all children under 
19, for boys and girls separately, and for children in different age groups. Although Jobs-First 
GAIN provided no special services for children, it may have affected children indirectly through 
its impacts on mothers’ employment, earnings, welfare dependency, or the other outcomes dis- 
cussed above. This section also presents findings on additional outcomes that could have affected 
children: (1) the use and reliability of child care to support maternal employment (see the full 
report for effects on the use of child care for other reasons), (2) the mother’s marital status and 
living arrangements at the end of year 2, and (3) the frequency with which the mother and her 
children engaged in learning experiences or played together. Other effects of Jobs-First GAIN 
that may have affected children, such as changes in the mother’s self-esteem and stress level, 
were not measured. 

The impact estimates discussed in this section were calculated from single parents’ re- 
sponses to the Two-Year Client Survey. They provide only a broad-brush picture of Jobs-First 
GAIN’S effects on children’s well-being. In particular, the survey did not include several meas- 
ures of school readiness and behavioral adjustment often used in research on children. Further- 
more, some of Jobs-First GAIN’S effects on children may not have manifested themselves within 
the relatively short follow-up period. Finally, the analysis does not examine whether the pro- 
gram’s effects on children varied by family size or by the mother’s age, race/ethnicity, educa- 
tional attainment, or other background characteristics. 

• Jobs-First GAIN increased the use of child care — both care that recipi- 
ents paid for out of pocket and care that friends or family members pro- 
vided free of charge. Very few respondents in either research group re- 
ported using subsidized child care or receiving transitional child care 
benefits. 

Nearly 48 percent of experimental group members reported using child care during their 
current or most recent job, an increase of 13 percentage points relative to the control group level 
(Table 4). Nearly all of the increase was in child care used while parents were working at a full- 
time job. Jobs-First GAIN increased by 7 percentage points the proportion of parents who used 
paid child care. Most respondents who used this type of care paid for it out of pocket, and Jobs- 
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Los Angeles Jobs-First GAIN Evaluation 



Table 4 

Impacts on Child Care Use During Current or Most Recent Job 
for Single Parents Overall and by Age of Youngest Child at Random Assignment 



Outcome (%) 


Experimental 

Group 


Control Difference 
Group (Impact) 


Percentage 
Change (%) 


For all sample members 


Ever used child care 


47.7 


34.9 


12.8 *** 


36.8 


Ever used paid child care 


32.8 


25.9 


6.9 ** 


26.6 


Ever used unpaid child care 


14.9 


9.0 


5.9 ** 


66.3 


In average month, missed work or was late one or more 


days due to child care problems 


27.3 


16.8 


10.5 *** 


62.6 


Youngest child under 6 


Ever used child care 


58.2 


44.0 


14.2 *** 


32.3 


Ever used paid child care 


40.4 


32.2 


8.3 * 


25.7 


Ever used unpaid child care 


17.8 


11.8 


5.9 * 


50.2 


In average month, missed work or was late one or more 


days due to child care problems 


35.0 


19.6 


15.4 *** 


78.5 


Youngest child 6 or over 


Ever used child care 


33.3 


22.5 


10.9 ** 


48.3 


Ever used paid child care 


23.1 


16.6 


6.4 


38.7 


Ever used unpaid child care 


10.2 


5.8 


4.4 


75.9 


In average month, missed work or was late one or more 


days due to child care problems 


18.3 


1L2 


7.1 


63.3 



SOURCE: MDRC calculations from the Two-Year Client Survey. 

NOTES: The full parent sample included 372 experimental and 374 control members. The sample of parents 
whose youngest child was under 6 included 215 experimental and 218 control group members. The sample of 
parents whose youngest child was 6 or over included 156 experimental and 156 control group members. 
"Percentage change" equals 100 times "difference" divided by "control group." 

Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between outcomes for the experimental and control 
groups. Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 
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First GAIN did not affect whether payment was made out of pocket. Only 5 percent of experi- 
mental group members and 6 percent of control group members reported that DPSS or another 
agency helped them pay for care. (The last three results are not shown.) These findings are gen- 
erally consistent with anecdotal information on child care use among welfare recipients in Los 
Angeles. However, given that all welfare recipients were eligible for child care assistance from 
DPSS, these results may underestimate receipt of such assistance. Before April 1998, recipients 
could submit records of out-of-pocket child care expenses to DPSS and have their welfare check 
for the following month adjusted upward to compensate them for those costs. Starting in April 
1998 (and during the period when respondents were interviewed), recipients no longer submitted 
records of expenses but could arrange for DPSS to pay child care providers directly. 

The program also increased the use of unpaid child care arrangements. As would be ex- 
pected, respondents with children under 6 at random assignment were most likely to report hav- 
ing used child care while they were working. The impacts of Jobs-First GAIN on child care use 
were somewhat larger for this group than for parents of school-aged children. 

• Jobs-First GAIN increased the proportion of single parents who reported 
experiencing problems with child care that caused them to miss or be late 
for work. Such problems were most prevalent among families with pre- 
school-aged children. 

About 27 percent of experimental group respondents reported missing or being late for 
work at their current or most recent job for one or more days in an average month because of 
child care problems (Table 4). The program led to an 1 1 percentage point increase in missing or 
being late for work in the experimental group relative to the control group. The effect was most 
pronounced for experimental group members whose youngest child was under 6 at random as- 
signment. 



• Jobs-First GAIN had no effect on marriage, family composition, or 
amount of recreational time spent with children. 

Fifteen percent of control group respondents reported being married and living with a 
spouse or living with a partner at the end of year 2. In addition, one-fifth reported living with ex- 
tended family members. Jobs-First GAIN had no effect on these household composition and 
marital status outcomes for the whole survey sample or for families with children in different age 
groups. Approximately 40 percent of control group members stated that they played with their 
children every day of the week. Jobs-First GAIN also had no effect on this outcome, nor on the 
frequency with which mothers and children engaged in learning experiences such as going to a 
museum. (These results are not shown.) 

• Jobs-First GAIN had no systematic effect on children’s outcomes overall 
or on outcomes for girls or boys when separately examined. There is some 
evidence that Jobs-First GAIN unfavorably affected outcomes for pre- 
school-aged children, although it is difficult to assess the extent of these 
effects without a larger sample and more age-appropriate measures. 
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Of the 10 child outcomes examined, Jobs-First GAIN only had one statistically signifi- 
cant impact for children overall, and this impact was positive: The program decreased the propor- 
tion of children who were expelled or suspended from school (results not shown). When child 
outcomes were examined separately for girls and boys, no statistically significant impacts were 
found. However, a larger proportion of preschool-aged children in the experimental than in the 
control group, particularly of those aged 4 to 5 at the time of random assignment, were reported 
to have repeated a grade (most likely kindergarten or first grade) once they entered school and or 
to have had a condition that made their mothers’ going to work difficult. Jobs-First GAIN had 
only one impact (out of 19 comparisons; 15 are shown in Table 5) on school-aged children’s or 
adolescents’ academic achievement and schooling, behavioral and emotional adjustment, or 
safety: a 6 percentage point increase in the proportion of children aged 6 to 9 at random assign- 
ment who attended a special class for a physical, emotional, or mental condition. 



VIII. Cross-Program Comparisons 

• Jobs-First GAIN’S net cost fell well below that of Los Angeles’s earlier, 
education-focused GAIN program. 

As expected, the net cost of Jobs-First GAIN was much lower than — in fact, was less 
than one-quarter of — the net cost of Los Angeles GAIN. The difference in cost resulted in large 
part from DPSS’s switch from high-cost basic education and training to lower-cost job search 
services. 

• Jobs-First GAIN produced larger employment and earnings increases 
than Los Angeles GAIN. 

Table 6 shows how the two-year impacts of Jobs-First GAIN for single parents compare 
with those of its basic-education-focused predecessor. Members of the Los Angeles GAIN re- 
search sample underwent random assignment from July 1989 through March 1990. Unlike Jobs- 
First GAIN sample members, nearly all of them had received welfare continuously for three or 
more years at the time of random assignment, were jobless, and had no children under 6. To al- 
low for more meaningful comparisons between the two programs, in this analysis the impacts of 
Jobs-First GAIN and the county’s previous GAIN program were estimated only for people with 
these characteristics. In addition, all dollar impacts were converted into 1998 dollars. 

Table 6 shows that Jobs-First GAIN was more successful overall than Los Angeles 
GAIN. Jobs-First GAIN’S two-year employment impact is 4 percentage points larger than that of 
the earlier program, and its total earnings impact is $1,516 larger. In contrast, the two programs 
had similar impacts on welfare payments and receipt. These results indicate that a Work First 
program can be more effective in boosting employment and earnings than a basic-education- 
focused program, even in a major metropolitan area with high unemployment and in a welfare 
population that includes many recipients with low educational attainment, limited work history, 
and limited proficiency in English. 
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Los Angeles Jobs-First GAIN Evaluation 
Tables 

Impacts on Maternal Reports of Child Outcomes for 
Children of Single Parents, by Child’s Age at Random Assignment 



Outcome (%) 


Experimental Control Difference 
Group Group (Impact) 


Percentage 
Change (%) 


Children aged 3 to 5 


Ever repeated a grade 0 


6.2 


0.4 


5.9 *** 


1569.0 


Ever attended a special class for physical, 
emotional, or mental condition 8 


12.4 


10.3 


2.2 


21.2 


Ever had special physical, emotional, or mental 
condition that made parents' work difficult 


10.2 


5.8 


4.4 * 


76.1 


Children aged 6 to 9 


Performed well or very well in school 


63.6 


60.1 


3.5 


5.8 


Performed below average or not at all well in school 


8.9 


11.8 


-3.0 


-25.1 


Ever on honor roll or received special award 


53.6 


57.4 


-3.8 


-6.6 


Ever repeated a grade 


6.1 


6.6 


-0.5 


-7.9 


Ever suspended or expelled from school 


4.8 


8.4 


-3.6 


-42.8 


Ever attended a special class for physical, 


emotional, or mental condition 


15.5 


9.8 


5.6 * 


57.3 


Ever had special physical, emotional, or mental 
condition that made parents' work difficult 


5.5 


5.7 


-0.3 


-4.9 


Children aged 10 to 18 


Performed well or very well in school 


56.9 


56.8 


0.1 


0.2 


Performed below average or not at all well in school 


15.9 


13.4 


2.5 


18.5 


Ever on honor roll or received special award 


33.9 


36.9 


-3.0 


-8.2 


Ever repeated a grade 


4.0 


7.3 


-3.3 


-44.8 


Ever dropped out of school 


4.2 


4.7 


-0.5 


-10.3 


Ever suspended or expelled from school 


17.5 


21.2 


-3.7 


-17.3 


Ever attended a special class for physical, 


emotional, or mental condition 


11.6 


9.2 


2.4 


25.9 


Ever had special physical, emotional, or mental 
condition that made parents' work difficult 


6.4 


3.6 


2.7 


75.9 



SOURCE: MDRC calculations from The Two-Year Client Survey. 

NOTES: The sample of parents with children aged 3 to 5 included 222 experimental and 239 control group 
members. The sample of parents with children aged 6 to 9 included 208 experimental and 221 control group 
members. The sample of parents with children aged 10 to 18 included 245 experimental and 254 control group 
members. 

"Percentage change" equals 100 times "difference" divided by "control group." 

Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between outcomes for the experimental and control groups. 
Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 

“These measures were calculated only for children aged 4 to 5 (125 experimental and 125 control) 
because 3-year-olds were unlikely to have begun elementary school during the follow-up period. 




ES-24 



39 



Los Angeles Jobs-First GAIN Evaluation 
Table 6 

Comparison of Jobs-First GAIN’S Impacts with Los Angeles GAIN’S Impacts 



Jobs-First GAIN Los Angeles GAIN 

Difference 

Experimental Control Difference Experimental Control Difference Between 

Outcome Group Group (Impact) Group Group (Impact) Impacts 

Ever employed in 



years 1-2 (%) 


59.1 


50.1 


9.0 *** 


34.6 


29.5 


5.1 *** 


3.9 * 


Average total earnings 


in years 1-2 ($) 


6,146 


4,424 


1,722 *** 


3,571 


3,365 


206 


1,516 *** 


Average total AFDC/ 
TANF in 
years 1-2 ($) 


9,390 


10,386 


-996 *** 


14,889 


15,879 


-990 ••• 


-6 


Received AFDC/TANF 
in the last quarter of 
follow-up (%) 


66.2 


71.9 


-5.7 *** 


73.9 


77.2 


-3.2 •• 


-2.5 



SOURCE: MDRC calculations from administrative records. 

NOTES: Dollar averages include zero values for sample members who were not employed and for sample members 
who were not receiving welfare. 

Rounding may cause slight discrepancies in calculating differences. 

A two-tailed t-test was applied to differences between impacts for the demographically comparable 
subsamples. Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 
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IX. Subgroup Impacts for Single Parents 

• Jobs-First GAIN benefited a broad cross section of the welfare caseload, 
producing impacts for recipients with the most as well as the fewest bar- 
riers to employment, for people of different racial/ethnic backgrounds 
and different levels of English proficiency, and for recipients in all re- 
gions of Los Angeles County. Such consistency in impacts has rarely been 
found for Work First programs. 

Jobs-First GAIN produced impacts for three subgroups that are typically considered the 
least job-ready: nongraduates (people who had neither a high school diploma nor a GED certifi- 
cate at random assignment), people who did not work for pay in the year prior to random as- 
signment, and the “most disadvantaged” recipients. (These subgroups are not mutually exclu- 
sive.) The most disadvantaged subgroup, which consists of nongraduates who did not work in the 
year prior to random assignment and who had received welfare payments for at least two years 
cumulatively before random assignment, faced more barriers to employment than any other sub- 
group examined. As Figure 3 illustrates, Jobs-First GAIN raised two-year earnings and reduced 
welfare payments for each of these subgroups, demonstrating that Work First programs can work 
for recipients who lack education credentials, job skills, and work experience. 

Jobs-First GAIN also benefited recipients who faced fewer serious barriers to employ- 
ment, including people with a high school diploma or GED and people who worked in the year 
prior to random assignment, but it did not affect recently approved applicants for welfare. 

As shown in Figure 3, Jobs-First GAIN led to employment and earnings increases for all 
four racial/ethnic subgroups in the single-parent sample: non-Hispanic whites, African- 
Americans, Hispanics, and Asians. Moreover, for single parents with a limited command of Eng- 
lish, Jobs-First GAIN increased two-year earnings by $1,800 (or 45 percent) per experimental 
group member and reduced two-year welfare payments by more than $1,000 (9 percent; results 
not shown). These impacts represent a notable achievement for the program because lack of Eng- 
lish proficiency often limits job prospects. 



X. Impacts for Two-Parent Families (AFDC-Us) 

The evaluation’s research design permitted only one adult member of each two-parent 
household to be included in the research sample; it was decided that this would be the first adult 
in the household to show up for a program orientation during the sample intake period. Nearly 
half of the AFDC-Us in the sample are women. 

• Overall, Jobs-First GAIN produced large two-year impacts on both em- 
ployment and earnings. 

In the follow-up period, 55 percent of control group members in the AFDC-U group 
worked for pay (see Table 7). The average control group member earned $6,598 (including zeros 
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Los Angeles Jobs-First GAIN Evaluation 



Figure 3 

Two-Year Impacts on Earnings Gains and Welfare Savings for 
Selected Subgroups of Single Parents 



Welfare Savings 



Earnings Gains 




H.S. diploma or GED 
No H.S. diploma or GED 




Applicant 

Short-term recipient 
Long-term recipient 



$507 1 



I $589 



$856 



$1,244 1 




SOURCE: MDRC calculations from administrative records. 

NOTES: The impacts for applicants were not statistically significant. All other impacts were statistically 
significant at the 1 percent or 5 percent level. 

Rounding may cause slight discrepancies in calculating sums and differences. 

‘"Most disadvantaged" sample members had no high school diploma or GED, long-term welfare 
receipt, and no employment in the year prior to random assignment. 
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for people who never worked). Jobs-First GAIN produced a 10 percentage point increase in em- 
ployment and an earnings gain of $2,050, or 31 percent. These results acquire particular impor- 
tance in light of TANF’s work requirements, which are much stricter for two-parent families than 
for single parents. TANF requires a higher percentage of two-parent families than single parents 
(in 1998, 75 percent versus 30 percent) to work or participate in employment-related activities 
and requires that they work more hours per week (35 hours versus 20 hours) to be counted as 
participants. 

• Jobs-First GAIN led to large reductions in two-year AFDC/TANF and 
Food Stamp expenditures. 

The program reduced welfare expenditures by $1,429, or 12 percent, over the two-year 
follow-up period (see Table 7). As was the case for single parents, these savings resulted mostly 
from case closures, but also from lower average monthly grants for those still on welfare. At the 
end of year 2, 60 percent of experimental group members versus 66 percent of control group 
members were on welfare. The majority of experimental group members who were employed at 
the end of year 2 also received a welfare check. These results, while promising, demonstrate once 
again that it is difficult to move large numbers of recipients off assistance by instituting financial 
incentives to combine work and welfare. Jobs-First GAIN also reduced Food Stamp expenditures 
by $606, or 13 percent, over two years. 

• The earnings gain for members of two-parent families was offset by re- 
ductions in AFDC/TANF and Food Stamp payments, leaving average to- 
tal income unchanged. 

In year 2, both experimental and control group members received an average of about 
$1 1,400 in earnings (minus payroll taxes), EITC payments, AFDC/TANF, and Food Stamps. Al- 
though this finding means that Jobs-First GAIN did not boost income for AFDC-Us, it may nev- 
ertheless be viewed as relatively positive because most previously evaluated welfare-to-work 
programs actually reduced overall income for members of two-parent families. (The effect of 
Jobs-First GAIN on income is uncertain, however, because earnings and other income from 
spouses and partners were not measured.) 

• Jobs-First GAIN led to larger increases in employment for women than 
for men. The two-year earnings gain, however, was nearly twice as large 
for men as for women. The reduction in welfare expenditures was also 
larger for men. 

Over two years, Jobs-First GAIN produced a large (12 percentage point) employment 
gain for women and a somewhat smaller (8 percentage point) increase for men. However, the 
two-year earnings gain was nearly twice as large for men ($2,645) as for women ($1,486), de- 
spite men’s smaller gain in employment (see Figure 4). This is because male experimental group 
members who worked earned more per quarter (on average) than their control group counter- 
parts, whereas female experimental group members did not (results not shown). 

Jobs-First GAIN reduced two-year AFDC/TANF payments by a significantly larger 
amount for men ($1,750, or 14 percent) than for women ($1,005, or 9 percent). For both sub- 
groups, the program continued to reduce AFDC/TANF receipt and payments at the end of fol- 
low-up, but savings were larger for men. 
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Los Angeles Jobs-First GAIN Evaluation 



Table 7 

Two-Year Impacts on Employment, Earnings, Welfare, and Food Stamps 
for Members of Two-Parent Families 





Experimental 


Control 


Difference 


Percentage 


Outcome 


Group 


Group 


(Impact) 


Change (%) 



Over the two-year follow-up period 



Ever employed (%) 


64.7 


55.0 


9.7 *** 


17.6 


Average total earnings ($) 


8,648 


6,598 


2,050 *** 


31.1 


Average total AFDC/TANF payments received ($) 


10,303 


11,732 


-1,429 *** 


-12.2 


Average total Food Stamps received ($) 


4,145 


4,751 


-606 *** 


-12.7 


In the last quarter of follow-up (%) 










Employed 


46.0 


38.2 


7.7 *** 


20.2 


Received AFDC/TANF 


59.7 


65.9 


-6.3 *** 


-9.5 


Received Food Stamps 


60.3 


66.7 


-6.4 *♦* 


-9.6 


Sample size (total = 5,048) 


4,039 


1,009 







SOURCE: MDRC calculations from administrative records. 

NOTES: "Percentage change" equals 100 times "difference" divided by "control group." 

Rounding may cause slight discrepancies in calculating sums and differences. 

A two-tailed t-test was applied to differences between outcomes for the experimental and control groups. 
Statistical significance levels are indicated as: * = 10 percent; ** = 5 percent; and *** = 1 percent. 
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Los Angeles Jobs-First GAIN Evaluation 



Figure 4 

Two-Year Impacts on Earnings Gains and Welfare Savings for 
Selected Subgroups of Members of Two-Parent Families 



Welfare Savings 



Earnings Gains 




Employed in prior year 



Not employed in prior year 



Most disadvantaged 8 



h 



-h 






$1,655 mi 




¥ 



$2,105 



-h 



-+- 



-h 



H 



$3,500 $2,500 $1,500 $500 $500 $1,500 $2,500 $3,500 $4,500 $5,500 



SOURCE: MDRC calculations from administrative records. 

NOTES: The impacts for applicants were not statistically significant. All other impacts were statistically 
significant at the 1 percent or 5 percent level. 

Rounding may cause slight discrepancies in calculating sums and differences. 

8 "Most disadvantaged" sample members had no high school diploma or GED, long-term welfare 
receipt, and no employment in the year prior to random assignment. 
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• The program positively affected many subgroups of two-parent families, 
but not as consistently as it did single-parent subgroups. 

As shown in Figure 4, Jobs-First GAIN increased two-year earnings and reduced welfare 
payments for AFDC-Us who entered the program with relatively severe disadvantages in the la- 
bor market: no high school diploma or GED, no recent work experience, and long-term welfare 
receipt. Less positively, earnings remained low for experimental group members in these sub- 
groups, averaging from $2,500 per year (for the most disadvantaged) to a little more than $4,000 
per year (for those with no high school diploma or GED). (Both averages include zeros for sub- 
group members who did not work for pay in year 1 or year 2.) Jobs-First GAIN produced espe- 
cially large two-year earnings gains and welfare savings for the most job-ready AFDC-Us: those 
who worked for pay in the year before random assignment and were short-term welfare recipi- 
ents. For reasons that are unclear, the impacts on earnings and welfare payments were smaller for 
high school graduates and GED recipients than for nongraduates. 

The earnings gain for Hispanic AFDC-Us averaged more than $1,900 per year, an unusu- 
ally large impact. Asian AFDC-Us experienced a more moderate gain of about $700 per year. In 
light of the fact that about half of Hispanics and almost three-fourths of Asians in the AFDC-U 
sample lacked English proficiency at random assignment, these results are impressively positive. 
Non-Hispanic white AFDC-Us did not benefit as much from the program. Jobs-First GAIN 
raised their employment level (result not shown), but produced only a small and not statistically 
significant increase in their earnings. The program reduced welfare expenditures for all three ra- 
cial/ethnic groups analyzed. The savings were largest for Hispanics (21 percent) and smallest for 
non-Hispanic whites (7 percent). There were not enough African-American AFDC-Us to allow 
for reliable analysis. 



XI. Estimates of Jobs-First GAIN’S Cost-Effectiveness 

The full report provides a limited benefit-cost analysis of Jobs-First GAIN both for single 
parents and for members of two-parent families. First, it considers whether experimental group 
members became better off financially as a result of their exposure to Jobs-First GAIN’S services, 
messages, and mandates. The analysis also assesses whether the program saved the federal, state, 
and local governments money. Whether made from the perspective of the welfare sample or from 
the perspective of the government budget, the benefit-cost estimates rest on the assumption that 
Jobs-First GAIN continued unchanged through the two-year follow-up period (that is, that Los An- 
geles County did not implement CalWORKs) and that control group members continued to be 
barred from the program’s services, messages, and mandates. 

The primary benefit-cost estimates cover a five-year time horizon starting with the first 
quarter after random assignment (quarter 2), which includes an observation period and a projection 
period. The observation period for each sample member encompasses the first two years after his or 
her random assignment. Based on several assumptions about trends over time, the gains and losses 
observed at the end of year 2 were then projected through the end of year 5. The analysis presents 
two estimates, each based on a different set of trend assumptions. The more conservative estimate 
is based on the assumption that Jobs-First GAIN’S effects at the end of year 2 will decay over time, 
hitting $0 at the end of year 5. The more optimistic estimate is based on the assumption that the 
program’s effects will remain constant from the end of year 2 through year 5. (Both patterns have 



been observed in earlier evaluations of welfare-to-work programs. For some programs, however, 
the effects actually increased in later years.) For both estimates, the dollar value of each projected 
effect was discounted at a rate of 5 percent per year to reflect the fact that dollars earned or saved in 
the future cannot be invested and are, therefore, worth less than dollars earned or saved in the pre- 
sent. All benefit-cost estimates are expressed in 1 998 dollars. 

• Over five years after random assignment, AFDC-FG experimental group 
members will have achieved a small financial gain relative to their control 
group counterparts, whereas AFDC-U experimental group members will 
have incurred a small financial loss. 

A program produces a net gain from the standpoint of the welfare sample if experimental 
group members’ earnings gains, fringe benefits, and EITC payments exceed the value of reductions 
in their transfer payments and increases in the taxes and child care costs that they pay. Considering 
only the observed (that is, two-year) effects on single parents, experimental group members’ in- 
creased income from earnings, fringe benefits, and EITC payments exceeded by about $400 their 
loss from paying payroll and sales taxes and out-of-pocket child care costs and from receiving less 
in welfare, Food Stamps, and Medi-Cal. Single parents in the experimental group continued to real- 
ize a small net gain in income at the end of year 2. Projected through the end of year 5, these results 
increase the size of the welfare sample’s net gain by an additional $200 to $400 per experimental 
group member, depending on trend assumptions. AFDC-U experimental group members did not 
fare as well in the observation period and will not fare as well in the projection period: Depending 
on trend assumptions, they are expected to incur a net loss of between $300 and $700 over five 
years. (None of the benefit-cost results discussed above are shown.) 

• Jobs-First GAIN will lead to substantial savings to the government budget 
for both AFDC-FGs and AFDC-Us. 

From the perspective of the government budget, a welfare-to-work program is cost-effective 
if the value of increases in tax revenues (minus EITC payments) and savings in welfare, Food 
Stamps, and Medi-Cal payments and administrative costs exceeds the net cost of providing em- 
ployment-related services to experimental group members. For AFDC-FGs, Jobs-First GAIN will 
very likely realize between $2 and $3 in increased revenues and savings for every additional dollar 
spent on experimental group members, a substantial return to the budget. The net gain to the gov- 
ernment budget is likely to be even higher for AFDC-Us (results not shown). 



XII. Discussion and Implications 

As noted above, many TANF-era programs, including Jobs-First GAIN’S successor, 
CalWORKs, are offering post-employment services and more generous financial incentives to 
increase employment, job retention, and advancement among welfare recipients. The two-year 
findings presented in this summary of the final report on the Jobs-First GAIN Evaluation confirm 
that pre-employment services remain an important part of a welfare-to-work program’s strategy 
for fostering self-sufficiency. Los Angeles County’s transition from a basic-education-focused 
welfare-to-work program to a strongly employment- focused program was successful: Jobs-First 
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GAIN achieved relatively large two-year employment and earnings gains exceeding those for 
Los Angeles GAIN by a wide margin. Even more impressive is the fact that Jobs-First GAIN’S 
overall impacts remained large at the end of year 2 and will almost certainly continue. Moreover, 
Jobs-First GAIN demonstrates that a welfare-to-work program can succeed in one of the coun- 
try’s large urban areas, where welfare-to-work programs have traditionally fared poorly, and for 
many different types of welfare recipients, including people with low English proficiency and 
people with other severe disadvantages in the labor market. 

The findings of the evaluation also point to areas where CalWORKs’ additional services 
and incentives may be instrumental. One-third of experimental group members in the Jobs-First 
GAIN Evaluation never worked for pay in the two-year follow-up period. Before TANF, people 
who could not find jobs after enrolling in a welfare-to-work program faced the greatest risk of 
experiencing long-term welfare dependency. Under TANF, they risk reaching time limits in wel- 
fare eligibility. In Los Angeles, these people may benefit from CalWORKs’ wider range and 
more targeted mix of services, including greater access to skill-building activities combined with 
part-time employment, more aggressive case management and supportive services to help people 
overcome barriers to employment, and special services to address domestic violence, mental 
health problems, and substance abuse. Other experimental group members who appear not to 
have benefited from Jobs-First GAIN’S services and mandates (at least not within the first two 
years of follow-up) include those who worked sporadically or worked at low-paying jobs without 
fringe benefits. The evaluation also found that unreliable child care arrangements caused many 
experimental group members to miss or be late for work. Under CalWORKs, welfare recipients 
with these problems may benefit from access to post-employment services that increase job re- 
tention or speed the transition to a new job and from more aggressive case management to ensure 
that all who qualify for Transitional Medi-Cal and child care benefits and for the EITC receive 
these types of assistance. 

The two-year impacts of Jobs-First GAIN on employment and welfare status also high- 
light issues that CalWORKs’ current mix of services and financial incentives may not address. 
Notably, the program was more successful at reducing welfare expenditures than at moving re- 
cipients off assistance. This finding may be expected, because the program encouraged enrollees 
to take advantage of California’s Work Pays financial incentives by combining work and welfare 
in the short term. As noted earlier, CalWORKs provides a somewhat stronger financial incentive 
to combine work and welfare, but at the same time puts a five-year limit on adults’ eligibility for 
assistance. At some point, the program will need to increase the rate of exits from assistance — 
otherwise, many adult recipients will begin to encounter lifetime limits on eligibility without a 
means of compensating for the lost income. The key issue is whether welfare recipients advance 
to jobs that offer stable, full-time employment at hourly wages exceeding the relatively high eli- 
gibility cutoff for continued assistance. However DPSS modifies its welfare-to-work program to 
meet this challenge, Jobs-First GAIN’S mix of services, messages, and financial incentives will 
likely continue to be an integral part of DPSS’s efforts to promote employment and self- 
sufficiency. 
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Chapter 1 

Introduction 



This report summarizes the two-year findings from a large-scale, rigorous evaluation of 
the effectiveness of Jobs-First GAIN, Los Angeles County’s strongly employment-focused wel- 
fare-to-work program. Jobs-First GAIN emphasized job search assistance and imparted a strong 
pro-work message in an effort to move thousands of welfare recipients quickly into jobs and, as 
soon as feasible, off the welfare rolls. This message and emphasis place Jobs-First GAIN in the 
category of Work First programs, the approach followed by most current state and local welfare- 
to-work programs. The evaluation, conducted by the Manpower Demonstration Research Corpo- 
ration (MDRC), has been jointly funded by the Los Angeles County Department of Public Social 
Services (DPSS), the U.S. Department of Health and Human Services, and the Ford Founda- 
tion. 



DPSS began implementing Jobs-First GAIN in mid-1993 under provisions of the federal 
Family Support Act (FSA) of 1988. The program anticipated the philosophy and goals of the 
federal legislation of 1996 that replaced Aid to Families with Dependent Children (AFDC) and 
the FSA with block grants to the states called Temporary Assistance for Needy Families 
(TANF). Most of Jobs-First GAIN’S features were preserved under Los Angeles County’s TANF 
program, California Work Opportunity and Responsibility to Kids (CalWORKs). The similarities 
between the two programs make the findings of this evaluation especially useful to practitioners 
and researchers interested in the effects of CalWORKs. 

The differences between Jobs-First GAIN and CalWORKs are also of interest. Like many 
other TANF-era programs, Los Angeles CalWORKs added to its predecessor’s program model 
time limits on welfare eligibility (although limited to adult recipients on the case), somewhat 
stronger financial incentives to work, extended transitional benefits, and post-employment ser- 
vices aimed at increasing job retention and advancement. 1 The Jobs-First GAIN Evaluation thus 
investigates the effects of CalWORKs’ primary pre-employment strategy, but without features 
that administrators and policymakers in Los Angeles and in many other locales now advocate as 
important for helping former recipients stay employed and off public assistance. Jobs-First 
GAIN’S effects on employment, earnings, welfare dependency, and income will serve as a 
benchmark for gauging the effects of CalWORKs’ more comprehensive approach to promoting 
self-sufficiency. 

Further, any success achieved by Los Angeles County in moving large numbers of wel- 
fare recipients into jobs and off assistance will have broad significance. Los Angeles operates the 
largest county welfare program in the nation, serving more recipients than all states except New 
York and, of course, California. Moreover, the nation’s welfare population has become increas- 
ingly concentrated in its largest cities. According to a recent study, in 1996 the typical U.S. city 
had a larger share of its state’s welfare population than of its state’s total population. The same 
study found that most large cities and urban counties “did not perform as well as their states in 



'As will be discussed below, CalWORKs also added special services for victims of domestic violence and for 
people with mental health or substance abuse problems. 
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moving recipients off the welfare payrolls.” 2 Thus, the future success of welfare reform will to a 
great extent depend on whether administrators and staff of large, urban welfare-to-work pro- 
grams like Los Angeles County’s can design and implement innovative, effective approaches. 

This is the third and final report on the evaluation. The first report, Changing to a Work 
First Strategy: Lessons from Los Angeles County’s GAIN Program for Welfare Recipients (1997), 
described how DPSS turned the Human Capital Development (HCD) model of its Greater Avenues 
for Independence (GAIN) program (primarily a basic-education model) into a Work First model. 
The second report, The Los Angeles Jobs-First GAIN Evaluation: First-Year Findings on Partici- 
pation Patterns and Impacts (1999), began the study of whether these changes made a difference. 
It described patterns of participation in Jobs-First GAIN and presented estimates of the pro- 
gram’s effects on employment, earnings, and welfare receipt in the year following the date on 
which people enrolled in Jobs-First GAIN and attended a program orientation. The second report 
concluded that Jobs-First GAIN produced a substantial initial boost in employment and earnings 
relative to what welfare recipients would have achieved in the absence of the program and pro- 
duced this effect for a wide range of welfare subgroups. Jobs-First GAIN also produced small 
reductions in welfare and Food Stamp receipt, but larger decreases in expenditures for public as- 
sistance. 

The current report explores Jobs-First GAIN’S impacts on employment, earnings, and 
AFDC/TANF and Food Stamp receipt and payments over the second year of follow-up. The re- 
port also looks at a much wider array of program effects than did previous reports, including: (1) 
employment stability and wage growth, (2) income and self-sufficiency of welfare recipients and 
other household members, (3) medical coverage, (4) child care use, (5) household structure, and 
(6) child outcomes. Further, the report examines Jobs-First GAIN’S cost-effectiveness. It in- 
cludes estimates of the additional, or net, costs of providing services to program enrollees — that 
is, over and above the cost of services for a similar group of welfare recipients who were not in 
the program. It then considers whether Jobs-First GAIN made welfare recipients better off finan- 
cially and whether government agencies realized more in increased taxes and savings in welfare, 
Food Stamps, and Medi-Cal and administrative costs than they spent providing services to 
enrollees. 



I. Summary of Los Angeles County’s Welfare Reform Efforts 

From 1988 to 1993, DPSS ran the GAIN program, California’s welfare-to-work initiative 
under the FSA. The program closely followed statewide directives to provide basic education ser- 
vices to recipients who lacked a high school diploma or high school equivalency (General Educa- 
tional Development, or GED) certificate, demonstrated low levels of literacy or poor math skills, or 
lacked English proficiency. GAIN staff assigned most welfare recipients who entered the program 
to classes in Adult Basic Education (ABE), GED preparation, or English as a Second Language 
(ESL; see Table 1.1). Lacking funds to serve all welfare recipients mandated to participate and re- 
quired by FSA provisions to give priority to recipients at greatest risk of long-term welfare depend- 



2 Bruce Katz and Kate Camevale, “The State of Welfare Caseloads in America’s Cities” (Washington, D.C.: 
Brookings Institution, May 1998), as quoted in Judith Havemann, “Welfare Reform Success Cited in L.A.,” Wash- 
ington Post, August 20, 1998, p. Al. 
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ency, DPSS served almost exclusively adults who had received continuous assistance for three or 
more years. In its initial years of operation, GAIN served few recipients with children under age 6, 
despite the FSA mandate to enroll recipients with children as young as 3. Evidence from several 
sources — including an evaluation of the program by MDRC, agency reports on participation and 
job placement, and discussions with supervisors and staff — showed that GAIN’S basic education 
approach was not working: Despite being costly, the program helped relatively few people attain 
additional educational credentials or find employment. 3 

In 1993 DPSS administrators began a total overhaul of the GAIN program. They resolved 
that a Work First approach — a program that offered job search assistance as its primary service 
and encouraged welfare recipients to start working as soon as possible — would help greater num- 
bers of welfare recipients achieve self-sufficiency. In consultation with administrators of success- 
ful Work First programs, including the GAIN program in neighboring Riverside County, and 
working with administrators in the Los Angeles County Office of Education (COE), DPSS admin- 
istrators fashioned an innovative, strongly employment-focused program, which they named Jobs- 
First GAIN. 

Jobs-First GAIN combined program services and mandates that had worked in other set- 
tings and some that were relatively new (see Table 1.1). Its main features included: (1) an unusu- 
ally intensive program orientation aimed at motivating new enrollees to find work quickly; (2) 
high-quality job clubs, the leaders of which taught job-finding skills and engaged participants in 
activities aimed at boosting their self-esteem and motivation to work; (3) job development activi- 
ties to increase job opportunities and to match people with prospective employers; (4) a strong 
Work First message, communicated through written handouts and group presentations and in 
one-on-one meetings with program staff; (5) a warning, conveyed orally and in writing, that Cali- 
fornia would impose time limits on welfare eligibility for those who did not work; (6) a con- 
certed effort to teach people that California’s relatively generous rules for calculating welfare 
grants would help them increase their income in the short term by combining work and welfare; 
and (7) a relatively tough, enforcement-oriented approach to encourage people to complete the 
program activities and find work quickly. 

Jobs-First GAIN’S start-up phase began in July 1993, when DPSS contracted with COE 
to operate the program’s orientation meetings and job clubs, and was completed in 1995. A num- 
ber of operational changes were required to implement a Work First program. These included: 
(1) developing a curriculum, hiring staff, and renting and equipping facilities to run orientations 
and job clubs throughout the country; (2) changing case management practices to increase as- 
signments to job club and encourage job placements; and (3) crafting a consistent pro-work mes- 
sage to communicate to welfare recipients who enrolled in the program. Many of these changes took 
place within a year of the start-up. By early 1994, DPSS’s reports showed a significant increase 
in the number of participants in job club and an increase in job placements relative to the previ- 
ous GAIN program. Other changes took longer to implement. For instance, in 1 995 California 



3 Riccio et al., 1994, summarize the results of an MDRC evaluation of the GAIN program in Los Angeles and 
five other counties. Weissman, 1997, provides a detailed description of the creation of Jobs-First GAIN. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 1.1 

Selected Characteristics of Los Angeles GAIN, Jobs-First GAIN, and Cal WORKs 



Characteristic 


Los Angeles GAIN 


Jobs-First GAIN 


CalWORKs 


Time period 


1988-1993 (transition to 
Jobs-First GAIN occurred 
1993-1995). 


1995-1998. 


1998-present. 


Targeted 

populations 


Recipients on assistance for 
3 or more years; priority 
given to those with the 
longest spells of continuous 
receipt. Long waiting list for 
services owing to limited 
funds. 


Recipients on assistance for 
3-5 years; some newly 
approved applicants, short- 
term recipients, and very 
long-term recipients. 
Waiting lists for services. 


Most welfare recipients and 
recent applicants. 


Exemption criterion 
for parents of young 
children 


Youngest child must be 
under age 3. 


Youngest child must be 
under age 3. 


Youngest child must be 
under age 1 . 


Program orientation 


Short introduction to 
program. 


6-hour motivational session 
conveyed strong pro-work 
message. 


6-hour motivational session 
conveys strong pro- work 
message. 


Typical first post- 
orientation activity 


ABE or ESL; some assigned 
to GED preparation. 


Job club 


Job club 


Later activities 


Vocational skills assessment, 
followed by vocational 
training or work experience. 


Vocational skills assessment, 
followed by additional job 
club, vocational training, or 
work experience. 


Vocational skills assessment, 
followed by additional job 
club, vocational training, or 
work experience. 


Special services 


None 


None 


Screening and special 
services for victims of 
domestic violence and for 
enrollees with mental health 
or substance abuse 
problems. 


Other program 
features 


Literacy and math tests 
administered during 
orientation to determine 
need for basic education. 


Job development; strong 
message to begin work 
quickly, even at low-paying 
jobs; strong encouragement 
to combine work and 
welfare. 


Time-intensive participation 
required (32 hours/week); 
job development; strong 
message to begin work 
quickly, even at low-paying 
jobs; strong encouragement 
to combine work and 
welfare. 



(continued) 
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Table 1.1 (continued) 



Characteristic 


Los Aneeles GAIN 


Jobs-First GAIN 


CalWORKs 


Level of 
enforcement of 
mandatory 
participation 
requirements 


High 


High 


High 


Willingness to 
impose financial 
sanctions for 
noncompliance 


Low 


High 


High 


Post-employment 

services 


None 


None 


Up to 1 year of post- 
employment services (case 
management, job retention, 
human capital development 
services). 


Time limits on 
welfare eligibility 


None 


None; staff warned enrollees 
that time limits were coming 
to encourage enrollees to 
find work quickly. 


Parents not employed after 
1 8-24 months must perform 
community service; 5-year 
lifetime limit on cash 
assistance for adult portion 
of grant. 


Financial incentives 
to work 


Standard federal pre-TANF 
earnings disregards: first 
$120 and 1/3 of each 
additional dollar disregarded 
for first 4 months; $120 for 
next 8 months; $90 
thereafter. 


More generous earnings 
disregards than federal 
disregards: first $120 and 
1/3 of each additional dollar 
disregarded for each month 
of employment. Remaining 
earnings subtracted from a 
standard of need set higher 
than maximum grant level. 
Recipients can “fill the gap” 
with additional earnings 
without losing welfare 
benefits. 


Most generous earnings 
disregards of the three 
programs: first $225 and 
50% of each additional 
dollar disregarded for each 
month of employment. 


Transitional benefits 
for those who leave 
welfare due to 
employment 


Subsidized child care and 
Medi-Cal coverage for up to 
1 year. 


Subsidized child care and 
Medi-Cal coverage for up to 
1 year. 


Subsidized child care for 2 
years or until family’s 
income exceeds 75% of 
state’s median income; up to 
2 years of Medi-Cal 
coverage. 
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stopped requiring county welfare-to-work programs to assign any welfare recipients to basic 
education, which allowed DPSS to assign a higher percentage of program enrollees to job club. It 
also took time for DPSS and COE to develop partnerships with area employers to help welfare 
recipients learn about and apply for available jobs. 

Jobs-First GAIN was funded at higher levels than the previous GAIN program and em- 
phasized short-term job search assistance that cost less per participant than basic education 
classes. These changes enabled DPSS to serve a larger proportion of the welfare population than 
previously, including parents of preschool-aged children, newly approved applicants for assis- 
tance, and short-term recipients. Nevertheless, funding limitations and ongoing FSA require- 
ments to give priority to the most at-risk recipients prevented DPSS from bringing all eligible 
welfare recipients into the program. 

Passage of the federal Personal Responsibility and Work Opportunity Reconciliation Act 
(PRWORA) in August 1996 required California and all other states to transform their welfare-to- 
work programs. PRWORA placed a five-year lifetime limit on the length of time most families 
can receive federally funded welfare. It also required states to place increasingly high percent- 
ages of welfare recipients in jobs and employment-related activities and to submit plans for re- 
quiring welfare recipients to work after receiving two years of assistance. 

In August 1997, a year after the passage of PRWORA, Governor Pete Wilson signed into 
law Assembly Bill 1542, which replaced GAIN with CalWORKs, California’s TANF program. 
CalWORKs included limits on welfare eligibility for adults (but not for children); provision of 
one-time cash grants to applicants who forgo welfare; a requirement to be working full time at an 
unsubsidized job within 24 months of program entry for welfare recipients and 18 months for 
welfare applicants, or be placed in a community service job; more generous financial incentives 
to encourage full-time work; and extended child care benefits for recipients who leave welfare 
for employment. Importantly, CalWORKs dramatically increased funding for welfare-to-work 
services and mandated that counties serve all nonexempt recipients with children aged 1 or over 
by the end of 1998. 4 

California’s Department of Social Services, which oversees the state’s welfare programs, 
gave counties considerable latitude in operating CalWORKs. DPSS took the lead in developing 
Los Angeles County’s program, in consultation with a broad cross-section of public and private 
agency administrators, business leaders, welfare advocates, faith- and community-based organi- 
zations, welfare recipients, and other community members. DPSS kept Jobs-First GAIN’S mix of 
services, messages, and mandates as CalWORKs’ core pre-employment strategy. Beyond that, 
DPSS added special services for recipients with mental health or substance abuse problems and 
for victims of domestic violence and training for case managers to identify enrollees in need of 
these services. It also added post-employment services aimed at increasing job retention and ad- 
vancement and promoting rapid return to work for people who leave employment. These post- 
employment services include extended access to case management services, help in obtaining 
transitional benefits and the Earned Income Tax Credit (EITC), opportunities to attend vocational 
training classes while working, and job search assistance for people who leave employment. 



4 See Quint et al., 1999, Chapter 4, pp. 73-109; Morino et al., 1999; Zellman et al., 1999; and the Los Angeles 
County Department of Public Social Services website for a more detailed description of CalWORKs. 
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DPSS inaugurated Los Angeles CalWORKs on April 1, 1998. In many ways, the pro- 
gram represents a continuation of Jobs-First GAIN, but on a much larger scale. Statewide direc- 
tives required DPSS to serve all nonexempt recipients by the end of 1998. Before CalWORKS, 
DPSS served around 45,000 recipients at any one time. In the ensuing months, DPSS referred 
around 150,000 recipients to CalWORKs and maintained an active caseload that reached 100,000 
(see Table 1.2). DPSS hired new staff, expanded facilities, and opened new offices. Whether Los 
Angeles County’s economy can provide enough entry-level jobs to absorb the thousands of 
CalWORKs recipients who have entered the labor market is a key issue for the program. DPSS 
also faces the challenge of working with welfare populations who previously remained outside 
the program — in particular, recipients with very young children, whose child care needs are 
most acute. 5 



II. Key Features of Jobs-First GAIN 

In response to the passage of PRWORA in 1996, most states and localities have imple- 
mented some kind of Work First approach, with the central focus on rapid employment. Los An- 
geles’s version — Jobs-First GAIN, which was put in place prior to the federal law — had a 
number of features that together represent serious investments in the program. As noted above, 
all of these features, which are described below, have continued under CalWORKs (see Table 
1 . 1 ). 



• Communicating a strong Work First message 

Welfare administrators stated clearly that the goal of Jobs-First GAIN was to move peo- 
ple to employment as rapidly as possible. This philosophy was communicated to program enrol- 
lees through written handouts and group presentations and in individual meetings with program 
staff. 



• Warning enrollees that time-limited welfare is coming and urging them to 
get a job right away to preserve their eligibility for assistance 

Even before the federal welfare reform legislation was enacted in August 1996, Jobs-First 
GAIN staff were informing new enrollees that the federal and state governments would limit wel- 
fare eligibility, possibly to two years, and were encouraging them to find work in order to avoid the 
expected cuts in welfare. As one agency flier put it: 

Everyone will be expected to work. These changes could occur as early as 1996. It 
is critical that you prepare now for these social changes. Work experience is the best 
training. Remember: “WORK IS IN, WELFARE IS OUT.” 

The message was repeated during program activities, such as job club, and in meetings be- 
tween enrollees and program staff. 



5 See footnote 4. 



Los Angeles Jobs-First GAIN Evaluation 
Table 1.2 

Characteristics of the Program Environment, 
Los Angeles County 



Characteristic 




Population, 1990 a 


8,863,160 


Population, 1996 


9,369,800 


Population, 1998 


9,603,300 


Population growth, 1990-98 (%) 


8.4 


AFDC/TANF caseload 11 


July 1996 


306,253 


July 1997 


274,712 


July 1998 


244,569 


July 1999 


236,430 


Jobs-First GAIN/CalWORKs caseload 


July 1996 


33,720 


July 1997 


40,525 


July 1998 


62,547 


July 1999 


100,854 


Total DPSS expenditures for Jobs-First GAIN/CalWORKs ($) 


FY 95/96 


58,809,460 


FY 96/97 


63,300,738 


FY 97/98 


63,267,072 


FY 98/99 


164,122,049 


AFDC/TANF grant level for a family of three ($) c 


9/1/93 - 6/30/96 


607 


7/1/96-1/31/97 


594 


2/1/97 - 9/30/98 


565 


Food Stamp benefit level for a family of three ($) d 


10/1/95 - 9/30/96 


246 


10/1/96 - 9/30/97 


251 


10/1/97 - 9/30/98 


267 


Minimum wage ($) 


10/1/96 


4.75 


3/1/97 


5.00 


9/1/97 


5.15 


3/1/98 


5.75 


Unemployment rate (%) c 


1996 


8.2 


1997 


6.8 


1998 


6.6 


1999 


5.9 



(continued) 
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Table 1.2 (continued) 



Characteristic 


Employment growth (%) 




1996-97 


4.2 


1997-98 


3.7 


1998-99 


1.0 


Employment growth. 1996-99 (%/ 


12 . 



SOURCES: Published reports from the U.S. Bureau of the Census; California Department of Social 
Services, Employment Development Department; and Los Angeles County Department of Public 
Social Services. 

NOTES: 

‘‘Data are for Los Angeles County. 

b AJFDC/TANF caseload figures include single- and two-parent cases and refer to a monthly 
average. 

c AFDC/TANF grant levels are based upon the maximum aid payment. 

d Food Stamp allotments are based upon the AFDC/TANF maximum aid payment. 

*Data for 1996, 1997, 1998, and 1999 are annual averages. 

Employment growth is calculated by: 100 x (number employed in 1999 minus number 
employed in 1996) / (number employed in 1996). Employment totals for both dates were seasonally 
adjusted. 
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• Operating an unusually intensive program orientation 

All new enrollees attended a six-hour group orientation session, followed by an individual 
appraisal meeting with a case manager during their first day in the program. In contrast, most other 
welfare-to-work programs, including some that share Los Angeles County’s Work First 
philosophy, run much shorter orientations. Further, whereas in these other programs staff use 
most of the orientation time to collect background information on new enrollees and to assign 
them to their first employment-related activity, Jobs-First GAIN staff devoted most of the 
orientation to changing recipients’ perceptions of Jobs-First GAIN, communicating the program’s 
message to them, and increasing their self-esteem — particularly with regard to their ability to find 
work. At the appraisal meetings, case managers conveyed their expectation that enrollees would be 
working soon. They also discussed the availability of transitional child care and medical insurance 
for participants who leave welfare for employment. 

• Providing high-quality job search assistance 

The vast majority of those who actively participated in Jobs-First GAIN attended job 
clubs. Well-trained staff from COE ran these services at 15 Job Centers around the county, and 
— along with Jobs-First GAIN staff — monitored participants’ progress. Jobs-First GAIN’S job 
clubs provided instruction in many of the skills needed to obtain employment, including finding 
job openings, writing a resume and job application, and being interviewed. Job club participants 
then conducted up to two weeks of supervised job search using agency phone banks, job listings, 
and assistance from program staff. These features are typical of job clubs in many other welfare- 
to-work programs. Jobs-First GAIN’S job clubs, however, also featured a strong motivational 
component. The message and specially developed curriculum were upbeat, stressing how work 
can lift self-esteem and how a low-paying first job can lead to a better one in the future. In addi- 
tion, Jobs-First GAIN staff aggressively developed relationships with local employers and 
matched enrollees to specific job openings. These job development efforts went well beyond 
what is traditionally offered in job search activities. 

Jobs-First GAIN offered short-term basic education and vocational training classes as 
well, but assigned few enrollees to these activities. The program also made limited use of unpaid 
work experience jobs. 

• Using job development activities to support enrollees’ job search efforts 

Each Jobs-First GAIN office had job developers who cultivated relationships with local 
employers and compiled lists of job positions. Job developers then tried to match enrollees to 
available job openings, based on enrollees’ prior experience and interests. Job developers began 
working with enrollees during orientation and appraisal, and continued assisting their job search 
efforts during job club and other program components. Job developers also arranged and hosted 
job fairs for enrollees — small, weekly job fairs with one or two employers and larger, quarterly 
job fairs with many employers. One program office even experimented with having its job de- 
velopers work on a one-on-one basis with program enrollees who had received a financial sanc- 
tion (welfare grant reduction) for noncompliance with program requirements. 
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• Demonstrating that work pays 

California’s Work Pays rules for calculating welfare grants allowed many recipients to 
combine work and welfare under the Jobs-First GAIN program. Using waivers granted by the 
U.S. Department of Health and Human Services, Work Pays increased, above national standards, 
the amount of earnings that the welfare department disregarded (that is, did not count) in calcu- 
lating welfare grants. As specified by federal regulations, DPSS disregarded the first $120 of 
earnings plus one-third of the remainder. Normally, the remaining earnings would then be sub- 
tracted from the maximum grant amount available to the family, and the difference would be 
paid to the recipient as her welfare check. Under Work Pays, in contrast, the remaining earnings 
were subtracted from a higher standard of need. In effect, this method of calculating benefits, 
known as “fill-the-gap budgeting,” disregards additional earnings before reducing the grant. As a 
result, a welfare recipient with two children could, for example, have earned $375 in June 1997 
(during the second year of the evaluation) and still have received her maximum grant amount of 
$565. Further, she could have earned up to $1,221 and still remained on assistance. 6 Therefore, 
most welfare recipients who combined work and welfare could receive hundreds of dollars per 
month in income above what they would have received in welfare alone. 

Work Pays became part of Jobs-First GAIN’S strategy for convincing people to find em- 
ployment as quickly as possible, even if available jobs paid little. Jobs-First GAIN staff made a 
concerted effort to explain the financial benefits of Work Pays to new enrollees by walking them 
through several examples of grant calculations during motivational sessions at program orienta- 
tion and repeating this message in job club and other employment-related activities. 

• Running a relatively tough, enforcement-oriented program 

Jobs-First GAIN case managers made frequent use of the program’s formal enforcement 
procedures, including threats to reduce welfare grants, to encourage enrollees to participate in 
program activities or show good cause why they could not. As discussed later in this report, the 
vast majority of program enrollees received at least one warning that they were out of compli- 
ance with program rules. Nearly one in three AFDC-FGs and a quarter of AFDC-Us incurred a 
sanction (grant reduction) for noncompliance. A sanction entailed dropping the recipient (but not 
the recipient’s children) from the grant; the dollar value of a sanction thus varied with grant level 
and family size. Program administrators intended this high-enforcement case management ap- 
proach and the strong pro-employment message to complement the program’s high-quality, mo- 
tivational job clubs. Together, these components of Jobs-First GAIN’S approach encouraged en- 
rollees to find work quickly and discouraged them from spending a long time in the program. 



6 In June 1997, the standard of need for a family of three was $735. Thus, the grant calculations for this hypo- 
thetical welfare recipient under Work Pays are: $375 - $120 - $85 = $170; and $735 - $ 170 = $565. She could have 
earned up to $1,221 and still received welfare because: $1,221 - $120 - $367 = $734; and $735 — $734 = $1. 
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III. New Program Features of CalWORKs 7 

Some of the features of CalWORKs described below came into being in April 1998, 
when the program started, whereas others took several additional months or longer to start up. 

• Time limits on welfare eligibility 

Welfare recipients in California, as elsewhere, are subject to TANF’s five-year lifetime 
limit on eligibility for federally funded benefits. CalWORKs modifies this restriction by apply- 
ing it only to parents or guardians who receive welfare benefits for five years. The program drops 
these adult family members from the case, but commits state and county funds to provide ongo- 
ing support for children and other dependents. In effect, this policy reduces, but does not elimi- 
nate, welfare benefits for families who reach the five-year time limit. 

CalWORKs also imposes an interim time limit for recipients who complete their initial 
pre-employment activity (usually job club) without finding employment. Most people in this 
situation undergo a formal assessment of their occupational skills, career interests, and barriers to 
employment. CalWORKs staff then meet with recipients to review the results of their assessment 
and to develop an individualized welfare-to-work plan, which outlines a strategy for overcoming 
barriers to employment and specifies the next employment-related activity the recipient will at- 
tend. Once her welfare-to-work plan is completed, a welfare recipient may receive cash assis- 
tance for up to 24 additional months, or up to 18 months if she began receiving welfare after 
April 1998, the start of CalWORKs. Thereafter, she must be working in an unsubsidized job or 
participating in community service for at least 32 hours per week to remain eligible for assis- 
tance. 8 



• Grant diversion 

CalWORKs offers new and returning applicants for assistance who meet specific criteria 
a one-time payment (equivalent to up to three months of benefits) if they forgo welfare. Families 
are eligible for Medi-Cal (California’s Medicaid program) and child care assistance during grant 
diversion. 



• Financial incentives 

CalWORKs did not alter welfare grant levels initially, but changed the formula for calcu- 
lating grants. 9 Specifically, the program eliminated the practice of subtracting countable income 
from a higher standard of need. Instead, the first $225 of a recipient’s monthly earnings plus 50 



7 Quint et al., 1999, Chapter 4, pp. 73-109; Moreno et al., 1999; Zellman et al., 1999, Chapters 4 and 5, pp. 38- 
61; and the Los Angeles County Department of Public Social Services website. 

8 CalWORKs enrollees are expected to sign their welfare-to-work plan, but the 18- or 24-month time limit be- 
gins even if the enrollee refuses to sign. The program may exempt from time limits people determined to need spe- 
cial services for domestic violence, substance abuse, or mental health problems and people determined for other 
reasons to be unable to work or to participate in employment-related activities. According to DPSS, welfare recipi- 
ents can meet the community service requirement through a combination of part-time employment and participation 
in approved employment-related activities totaling at least 32 hours per week. Members of two-parent households 
must work or participate in community service at least 35 hours per week to maintain welfare eligibility. 

*ln November 1998, California raised maximum grant levels by about 8 percent A family of three could then 
receive a maximum grant of $61 1, $46 more than previously. 
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percent of the remainder are disregarded, and the remainder is subtracted from the maximum 
grant amount. For example, the hypothetical welfare recipient with two children mentioned ear- 
lier could have earned up to $1,353 in June 1998 (that is, $132 more than a year previously) and 
still remain on welfare. 10 Thus, the CalWORKs formula gives recipients a somewhat stronger 
incentive to increase work hours than the previous Work Pays formula in effect under Jobs-First 
GAIN. This aspect of CalWORKs began statewide in January 1998, three months before the 
launch of Los Angeles County’s CalWORKs program. 

• Child care payments for welfare recipients 

Under Jobs-First GAIN (and the GAIN program that preceded it), DPSS paid child care 
expenses for welfare recipients who participated in program activities. This practice continued 
under CalWORKs. However, CalWORKs changed the method of paying for child care used by 
recipients who worked for pay but still remained on welfare. Before CalWORKs, those who were 
employed paid for child care out of pocket and then submitted their expenses to DPSS along with 
their pay stubs. When determining a welfare recipient’s monthly welfare grant, DPSS disre- 
garded up to $175 per month in child care expenses for each child aged 2 or over (and up to $200 
per month per younger child). Employed recipients whose child care costs exceeded the maxi- 
mum allowable amount could apply for reimbursement under a separate Supplemental Child 
Care program. Under CalWORKs, DPSS pays child care providers directly, and welfare recipi- 
ents no longer have to pay for care first and then wait for reimbursement. 

• Transitional benefits 

CalWORKs offers recipients who leave assistance for employment subsidized child care 
for two years or until the family’s income reaches 75 percent of the state median. Under Jobs- 
First GAIN and the previous GAIN program, transitional child care benefits were available for 
only one year after welfare exit. CalWORKs also extends medical coverage for up to two years 
(compared with one year under Jobs-First GAIN and Los Angeles GAIN) to people who leave 
welfare for employment. 

• Post-employment services 

CalWORKs enrollees who find employment are eligible for case management services 
from the program while still receiving welfare and for one year after ceasing to receive a grant. 
Program staff can provide new workers with counseling to help them adjust to demands of work 
and family, assistance in applying for the EITC and transitional benefits, job search assistance (if 
enrollees leave employment), and referrals to counseling and treatment for problems related to 
mental health, substance abuse, or domestic violence. DPSS also pays for enrollees to attend job 
skills training programs during working hours for up to one year, if approved by enrollees’ em- 
ployer. 



l0 This hypothetical welfare recipient could have earned up to $1,353 and still received welfare under Cal- 
WORKs because: $1,353 — $225 — $564 = $564; and $565 — $564 = $1. The CalWORKs formula also discourages 
part-time or short-term employment. If this welfare recipient earned over $225 under CalWORKs (compared with 
$375 under Work Pays), she could no longer receive the maximum grant amount. 
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• Special services 

DPSS devoted additional funding and special training to help CalWORKs staff identify 
enrollees with problems related to mental health, substance abuse, or domestic violence. These 
enrollees may be referred to special counseling or treatment services instead of job club and still 
receive credit for meeting CalWORKs’ work requirements. Under Jobs-First GAIN (and its 
predecessor), many of these enrollees were exempted from the program’s participation require- 
ment without being referred to treatment or counseling. 



IV. An Overview of the Evaluation 

The Jobs-First GAIN Evaluation began in January 1996 and ended in June 2000. The 
evaluation involves nearly 21,000 welfare recipients who appeared at a Jobs-First GAIN office to 
enroll in the program between April and September 1996." It includes single parents (AFDC- 
FGs, or Family Group cases) — the great majority of whom are women — and parents in two- 
parent households (AFDC-Us, or Unemployed Parent cases). 12 

A. The Research Design 

Central to the evaluation is an experimental design in which people who showed up at a 
Jobs-First GAIN office to enroll in the program were assigned, at random, to the experimental 
group or, for comparison, the control group (see Figure 1.1); these two groups combined are re- 
ferred to as sample members. Experimental group members were given access to Jobs-First 
GAIN’S program services, including the initial orientation session, and its Work First message. 
They were subject to the program’s mandatory participation requirements and could incur a sanc- 
tion for noncompliance. Control group members did not attend the six-hour information and mo- 
tivational meeting at orientation and were precluded from receiving other Jobs-First GAIN ser- 
vices, but remained eligible to receive AFDC/TANF payments. Control group members could 
seek other services in the community and receive child care assistance from DPSS for employ- 
ment-related programs in which they enrolled on their own initiative. Control group members 
also received Work Pays financial incentives. 

Results for control group members represent the outcomes that would be expected for 
welfare recipients in the absence of Jobs-First GAIN. Differences in outcomes between the ex- 
perimental and control groups — referred to as experimental-control differences — represent the 
effects, or impacts, of Jobs-First GAIN. These impacts reflect the extra value associated with 
having access to Jobs-First GAIN services and exposure to its Work First message and manda- 
tory participation requirements. 



"See Freedman, Mitchell, and Navarro, 1999, Chapter 2, pp. 22-25, and Appendix B, pp. 110-1 18, for further 
discussion of DPSS’s procedures for referring welfare recipients to Jobs-First GAIN. 

l2 Califomia changed the labels for and definitions of assistance groups when it created CalWORKs. By agree- 
ment with DPSS administrators, this report uses the old labels to denote recipients in single-parent and two-parent 
households (AFDC-FGs and AFDC-Us, respectively). This strategy makes the report consistent with previous re- 
ports on Jobs-First GAIN and helps distinguish Jobs-First GAIN from CalWORKs. 
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Los Angeles Jobs-First GAIN Evaluation 
Figure 1.1 

Steps from Income Maintenance to Attendance at Jobs-First GAIN 
Orientation and Random Assignment 




Note: See Footnote 13, p. 16, for information on who was excluded from the research sample. 



B. Follow-up Period for Measuring Program Effects 

Jobs-First GAIN’S effects were measured over the two-year follow-up period after each 
sample member attended orientation and was randomly assigned to either the experimental or the 
control group. September 30, 1998, marked the end of the follow-up period for sample members 
who entered the program in September 1996, the final month of sample intake. Starting on Octo- 
ber 1, 1998, DPSS began assigning to CalWORKs all experimental and control group members 
who met the program’s mandatory participation criteria. 

C. Effects of CalWORKs’ Start-up 

Although CalWORKs started during the second year of the evaluation’s follow-up period, 
sample members’ exposure to the program was limited. By agreement with DPSS, control group 
members remained precluded from services. Further' experimental group members were not sub- 
ject to CalWORKs’ two-year limit on continuous eligibility for welfare until after the end of fol- 
low-up. In the final months of follow-up, experimental group members had access to Cal- 
WORKs’ special services and post-employment services. However, tabulations from DPSS’s 
automated program tracking system, the GAIN Employment Activity and Reporting System 
(GEARS), show that less than 1 percent of experimental group members made use of these ser- 
vices. Similarly, only a tiny proportion of employed experimental group members arranged for 
DPSS to pay child care providers directly. All sample members experienced the change in the 
grant calculation formula starting in January 1998. 



V. The Research Sample and Program Environment 

The full sample for the evaluation includes 20,731 AFDC-FG and AFDC-U welfare re- 
cipients who were randomly assigned to the experimental or control group between April 1 and 
September 11, 1996, when they appeared at a Jobs-First GAIN office for their scheduled pro- 
gram orientation (see Table 1.3). During the evaluation, DPSS followed the eligibility criteria 
written into the federal Family Support Act of 1988 (FSA) in determining which recipients were 
Jobs-First GAIN-mandatory. According to the FSA, any AFDC-FG parent whose youngest child 
was aged 3 or over and who did not meet exemption criteria was mandated to participate in a 
welfare-to-work program. Grounds for exemption included having a disabling illness, being em- 
ployed full time (30 hours or more per week), living in a remote area that made program activi- 
ties inaccessible, or being in at least the second trimester of pregnancy. These criteria also ap- 
plied to members of AFDC-U cases, except that AFDC-U parents of children under 3 who did 
not meet any exemption criteria were required to enroll in Jobs-First GAIN. Further, DPSS re- 
quired both parents on an AFDC-U case to enroll, an option given to states and localities under 
the FSA. 13 



,3 People who attended an orientation but were not randomly assigned include: welfare recipients under 19, 
people exempt from mandatory participation requirements who volunteered to enroll in the program, members of 
welfare cases that already included a sample member, and sample members from the evaluation of the earlier Los 
Angeles GAIN program. All these people received Jobs-First GAIN services but were not part of the research sam- 
ple. 
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Los Angeles Jobs-First GAIN Evaluation 



Table L3 

Overview of Sample Sizes, by Assistance Category, Enrollment Status, 

and Research Group 





Experimental 

Group 


Control 

Group 


Total 


Full sample 


AFDC-FGs 


11,521 


4,162 


15,683 


Percent 


73.5 


26.5 




Regular enrollees 


8,620 


3,821 


12,441 


Percent 


69.3 


30.7 




Early enrollees 


2,901 


341 


3,242 


Percent 


89.5 


10.5 




AFDC-Us a 


4,039 


1,009 


5,048 


Percent 


80.0 


20.0 




Total 


15,560 


5,171 


20,731 


Survey sample 


AFDC-FGs 


372 


374 


746 


Percent 


49.9 


50.1 




Regular enrollees 


294 


298 


592 


Percent 


49.7 


50.3 




Early enrollees 


78 


76 


154 


Percent 


50.6 


49.4 




Total 


372 


374 


746 



SOURCE: MDRC calculations using data from the GAIN Employment Activity and Reporting System 
(GEARS). 

NOTE: ^Regular and early enrollees combined. 

Early enrollees, unlike regular enrollees, volunteered for the program before their regular scheduled 
appointment. 
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Because DPSS did not have the resources to serve all welfare recipients mandated to par- 
ticipate, it implemented a targeting strategy. Prior to the start of the evaluation, the agency re- 
served nearly all places in Jobs-First GAIN for people identified by the FSA as being at the 
greatest risk of remaining on welfare for many years. Among members of this group, DPSS gave 
the highest priority to those who had received welfare continuously for at least three years. 

Anticipating the start of the evaluation, DPSS decided to change its targeting strategy so 
that the evaluation could determine the effects of the Jobs-First GAIN approach on a broad cross 
section of the welfare caseload and on various types of welfare recipients. To do this, DPSS 
administrators implemented a complex selection and weighting procedure. The resulting sample, 
which included nearly everyone who showed up at a Jobs-First GAIN office for their scheduled 
orientation between April and early September 1996, was drawn from specific groups and, in 
very broad terms, appears to reflect the diversity of the mandatory caseload. The sample differed 
from the full Jobs-First GAlN-mandatory caseload primarily in including a substantially smaller 
percentage of people going through a very long spell — at least five years — on welfare and in 
excluding teen parents and a few other groups. 

The sample includes 15,683 single parents (AFDC-FGs) and 5,048 parents in two-parent 
households (AFDC-Us). It includes welfare recipients who inhabit the inner-city neighborhoods 
of Los Angeles as well as recipients in the outlying suburbs. The sample is large and diverse with 
respect to race and ethnicity, age, family size, and several indicators of relative disadvantage in 
the labor market (see Table 1.4). Among AFDC-FG sample members, Hispanics formed the 
largest ethnic group (45 percent); about 31 percent were African-Americans; 17 percent were 
non-Hispanic whites; and 6 percent were Asians. Just over half of all the AFDC-FGs had at least 
one preschool-aged child (under 6), for whom child care would be needed. Nearly 20 percent of 
AFDC-U sample members were Asians (primarily Vietnamese and Cambodians), and about half 
of the AFDC-Us had limited English proficiency. Relative to the AFDC-FG group, the AFDC-U 
group included a larger percentage of non-Hispanic whites (many of them recent immigrants 
from Armenia) and a much smaller percentage of African-Americans. Further, the AFDC-U 
sample members had, on average, more children on their cases than did the AFDC-FG sample 
members (2.4 versus 2.0). 

A large majority of AFDC-FG and AFDC-U sample members faced one or more serious 
barriers to employment at the time of random assignment: Fewer than half of each group had 
graduated from high school or received a GED certificate; about 60 percent had not worked for 
pay in the prior three years; and about 70 percent had received welfare cumulatively for at least 
two years. Other members of the research sample faced fewer barriers to employment: About 30 
percent of both AFDC-FGs and AFDC-Us were newly approved applicants for assistance or had 
received assistance cumulatively for less than two years, and more than a quarter of each group 
had worked for pay in the year prior to random assignment. 



VI. The Program Environment 

A. County Demographic Characteristics 

With 9.6 million inhabitants spread over 4,000 square miles, Los Angeles County is the 
most populous in the nation; by itself, the city of Los Angeles has 3.7 million residents. The 
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Table 1.4 

Demographic Characteristics of the Full Sample 



Characteristic 


All 


AFDC-FGs 

Regular 

Enrollees 


Early 

Enrollees 


AFDC-Us 


Random assignment quarter (%) 


April-June 1996 


56.1 


54.6 


61.7 


56.2 


July-September 1996 


43.9 


45.4 


38.3 


43.8 


Female (%) 


92.8 


92.3 


94.9 


47.4 


Aid status 3 (%) 


Applicant 


3.6 


3.5 


3.9 


2.8 


Short-term recipient 


23.6 


22.9 


26.1 


28.8 


Long-term recipient (received AFDC for at least 2 years) 


72.8 


73.6 


70.0 


68.4 


5 years or more but less than 1 0 years 


15.6 


16.2 


13.3 


14.0 


10 years or more 


7.8 


7.4 


9.3 


2.4 


Less disadvantaged recipient b (%) 


42.5 


43.2 


39.9 


38.7 


Most disadvantaged recipient 0 (%) 


30.3 


30.3 


30.1 


29.7 


On AFDC as a child (%) 


Yes 


25.4 


24.3 


29.7 


13.1 


No 


74.3 


75.4 


70.1 


86.8 


Don't know 


0.3 


0.3 


0.2 


0.1 


Long-term, second-generation recipient (%) 


17.1 


16.3 


19.9 


6.5 


Likely to receive an exemption 1 (%) 


18.7 


20.0 


13.5 


20.3 


Previous employment (%) 


Employed within past year 


27.1 


27.7 


24.8 


29.4 


Employed within past 2 years 


34.6 


35.1 


32.9 


36.6 


Employed within past 3 years 


38.2 


38.5 


37.2 


40.1 


Current employment (%) 


Not employed 


90.5 


89.5 


94.3 


86.3 


Employed 


9.5 


10.5 


5.7 


13.7 


Employed 1-14 hours per week 


1.2 


1.2 


1.2 


1.3 


Employed 15-29 hours per week 


4.2 


4.6 


2.3 


8.5 


Employed 30 or more hours per week 


4.1 


4.6 


2.3 


3.9 


Highest degree/diploma earned (%) 


GED 


5.1 


5.1 


5.0 


2.7 


High school diploma 


35.7 


36.6 


32.3 


30.9 


Technical/AA/2-year college degree 


3.7 


3.8 


3.0 


3.5 


4-year (or more) college degree 


1.3 


1.3 


1.2 


3.4 


None of the above 


54.3 


53.2 


58.5 


59.5 


Has a high school diploma or GED (%) 


412. 


46.8 


41.6 


4Qi 
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Table 1.4 (continued) 



Characteristic 


AIL 


AFDC-FGs 

Regular 
Enrol lees 


Early 
Enrol lees 


AFDC-IJs 


Highest grade completed in school (%) 
Less than 8th 


13.8 


13.6 


14.7 


27.4 


8th 


2.9 


2.8 


3.3 


4.0 


9th 


6.1 


5.9 


7.0 


6.2 


10th 


9.8 


9.7 


10.3 


10.9 


11th 


19.2 


18.8 


20.7 


10.6 


12th 


36.6 


37.3 


34.0 


30 A 


Post high school 


11.2 


11.6 


9.7 


9.7 


No formal schooling 


0.4 


0.4 


0.3 


0.8 


Average highest grade completed in school 


10.8 


10.9 


10.6 


10.3 


Currently in a school or training program (%) 


13.5 


13.0 


15.6 


7.7 


Ethnicity (%) 


White, non-Hispanic 


17.3 


18.7 


12.1 


28.1 


Hispanic 


45.2 


43.8 


50.3 


46.8 


African-American* 


31.2 


30.2 


34.9 


5.3 


Asian/Pacific Islander 


6.1 


7.0 


2.6 


19.6 


Native American/Alaskan native 


0.3 


0.3 


0.2 


0.1 


Limited English proficiency (%) 


20.3 


19.5 


23.0 


51.7 


Age (%) 


Less than 25 


17.1 


16.1 


20.8 


10.7 


25-34 


40.8 


41.3 


39.1 


31.6 


35-44 


31.5 


31.8 


30.4 


40.7 


45 or older 


10.6 


10.8 


9.7 


17.0 


30 or older 


63.1 


63.8 


60.0 


76.4 


Average age (years) 


33.2 


33.4 


32.5 


36.2 


Parent under 24, no high school diploma (%) 


8.1 


7.3 


11.3 


5.5 


Marital status (%) 


Never married 


43.0 


42.8 


43.8 


9.1 


Married, living with spouse 


6.8 


7.0 


5.8 


87.8 


Separated 


34.3 


34.0 


35.6 


2.5 


Divorced 


14.1 


14.3 


13.1 


0.6 


Widowed 


1.8 


1.9 


1.7 


0.0 


Has at least one child in the following age groups (%) 


Under 6 


53.3 


52.3 


56.9 


59.4 


6-11 


54.7 


55.2 


52.8 


57.0 


12-18 


38.8 


39.2 


37.6 


44.4 


Age of youngest child (%) 


Under 3 


9.3 


7.7 


15.1 


33.0 


3-5 


44.0 


44.6 


41.8 


26.5 


_6 or older 


4L2. 


47 J 


43.1 
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Table 1.4 (continued) 



Characteristic 


AIL 


AFDC-FGs 

Regular 
Enrollees 


Early 

Enrollees 


AFDC-Us 


Number of children (%) 


None 


0.0 


0.0 


0.0 


0.0 


1 


43.0 


43.1 


42.7 


23.2 


2 


30.1 


29.8 


31.2 


36.9 


3 or more 


26.9 


27.1 


26.1 


39.9 


Average number of children 


2.0 


2.0 


2.0 


2.4 


Current housing status (%) 
Public 


5.5 


5.5 


5.5 


3.6 


Subsidized 


9.3 


8.9 


11.0 


6.4 


Emergency 


0.4 


0.4 


0.7 


0.1 


Other 


84.8 


85.3 


82.8 


89.9 


Research sample status (%) 


Experimental 


73.5 


69.3 


89.5 


80.0 


Control 


26.5 


30.7 


10.5 


20.0 


Sample size 


15.683 


12.441 


3.242 


5.048 



SOURCE: MDRC calculations using data from the GAIN Employment Activity and Reporting System (GEARS). 

NOTES: Sample members with missing data were excluded from the calculations of percentages and means. 

Early enrol lees, unlike regular enrol lees, volunteered for the program before their regular scheduled 
appointment. 

a "Applicants" include sample members who reported never having received AFDC on their own or a 
spouse’s case. "Short-term recipients" reported having received AFDC on their own or a spouse’s case for one 
month to less than two years at some time prior to random assignment. "Long-term recipients" reported having 
received AFDC on their own or a spouse’s case for two years or more at some time prior to random assignment. 

b "Les s disadvantaged" sample members are long-term recipients who had a high school diploma or GED 
certificate at random assignment and/or who worked for pay during the year prior to random assignment. 

c "Most disadvantaged" sample members are long-term recipients who did not have a high school diploma 
or GED certificate at random assignment and who did not work for pay during the year prior to random assignment. 

during orientation, but prior to random assignment, Jobs-First GAIN case managers identified sample 
members whose circumstances made them likely to be exempted from participation in Jobs-First GAIN. 
Recommendations for actual exemptions were made during appraisal meetings that followed random assignment, but 
only for experimental group members. 

c Los Angeles County does not distinguish between non-Hispanic and Hispanic African-Americans. 
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county is ethnically diverse: Approximately 42 percent of its inhabitants are Hispanics, while 
Asian-Americans and African-Americans represent about 12 percent and 10 percent, respec- 
tively. 14 The vast majority of Hispanics in the county are of Mexican descent, with Salvadorans 
being the next largest group. Approximately 46 percent of county residents over the age of 5 
speak a language other than English at home, 15 with the largest number (32 percent) speaking 
Spanish; the languages next most commonly spoken at home are Chinese, Tagalog, Korean, 
Japanese, and Vietnamese. Many speakers of these languages live in predominantly minority 
communities, such as South-Central and East Los Angeles, whereas others are spread throughout 
the county. 

B. Unemployment Rates and Poverty Levels 

Los Angeles County’s unemployment rate grew steadily in the early 1990s, rising from 
5.4 percent in April 1990 to a high of 10.8 percent in July 1992. As shown in Table 1.2, it then 
dipped to 8.2 percent during 1996, the first year of the evaluation. Since then, the rate has con- 
tinued to drop, averaging 6.6 percent in 1998 and 5.9 percent in 1999; however, even in these 
years, unemployment in the county remained above the national average. Employment numbers 
have reflected this trend, growing by about 325,000 workers, or 8.1 percent, between 1996 and 
1998 i6 coun ty’s poverty rate decreased only slightly during these years, from 23.4 percent to 
22.1 percent. Poverty rates varied greatly by race and ethnicity. In 1998, nearly one-third of His- 
panics in Los Angeles County had incomes below the federal poverty threshold, compared to less 
than 10 percent of non-Hispanic whites. The poverty rate for African-Americans matched the 
county average (22 percent), and was lower for Asians (16 percent). 17 

To a greater extent than in most U.S. urban areas, poor people live throughout the county. 
There are pockets of poverty not only in the city of Los Angeles, but also in many of the outlying 
suburban communities. Moreover, although the county’s economy has significantly improved 
over the last several years overall, local community unemployment rates vary considerably. For 
example, communities like South-Central and East Los Angeles — where more than 90 percent 
of the residents are either African-American or Hispanic — still have unemployment rates of 9 
percent or higher. 18 

C. AFDC/TANF Caseload and Grant Levels 

The county’s AFDC/TANF caseload numbers have followed the trends in employment 
figures. As shown in Table 1.2, the welfare caseload totaled about 306,000 in July 1996. The 
number fell steadily during the follow-up period, reaching about 240,000 in September 1998 and 



,4 Los Angeles County website, “County of Los Angeles Statistical Data”; California Department of Finance 
(Demographic Research Unit) website, “Race/Ethnic Estimates by County,” January 1998. 

,5 United Way of Greater Los Angeles. State of the County Databook, Los Angeles 1996-97, Table 13, pp. 129- 
136. 

,6 Califomia Employment Development Department (Labor Market Information Division) website, “Civilian 
Labor Force, Employment, and Unemployment.” 

’’Tabulations from U.S. Census Bureau, Current Population Survey. Reprinted in United Way of Greater Los 
Angeles, State of the County Databook, Los Angeles 1998-99, Table 127. 

,8 Califomia Employment Development Department (Labor Market Information Division) website, “Labor 
Force Data for Sub-County Areas (Los Angeles County), February 2000.” 
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236,000 in July 1999. Los Angeles County accounts for more than one-third of the entire Cali- 
fornia caseload. 19 

AFDC/TANF grant levels declined by nearly 7 percent over the course of the evaluation 
(see Table 1.2). The maximum aid payment in California for a family of three in April 1996 was 
$607. The state reduced it in July 1996, to $594, and again in July 1997, to $565. 20 Food Stamp 
levels rose slightly more than 8 percent during this period, increasing from $246 in October 
1995, to $251 in October 1996, to $267 in October 1997. The maximum payment levels for wel- 
fare and Food Stamps remained in place until after September 1998, the final month of follow-up 
for the evaluation. Between the beginning and the end of the evaluation period, welfare recipients 
who did not work experienced a 2.5 percent decrease in their AFDC/TANF and Food Stamp 
benefits. 



VII. Research Questions for This Report 

A. Participation 

The report on the first-year findings from the evaluation concluded that all experimental 
group members encountered Jobs-First GAIN’S strong pro-work message during the six-hour 
orientation session and at other times. Relatively few experimental group members (38 percent of 
AFDC-FGs and 30 percent of AFDC-Us), however, participated in employment-related activities 
in year 1. Participation was short term: Nearly all participants attended one three- week spell of 
job club, and very few took part in longer-term education and training activities. That report also 
found that Jobs-First GAIN case managers made extensive use of enforcement procedures. About 
23 percent of AFDC-FGs and 17 percent of AFDC-Us incurred a sanction for noncompliance 
with Jobs-First GAIN’S mandatory participation requirements during the first year of follow-up. 
These rates exceeded by a wide margin the sanction rate for the earlier GAIN program in Los 
Angeles, but were comparable to those found for some other employment-focused programs in 
the 1990s. The current report, which explores whether these patterns continued in year 2, ad- 
dresses the following questions: 

• Did participation levels continue to be relatively low? Or did a large percent- 
age of experimental group members who had not previously attended a Jobs- 
First GAIN activity after orientation begin participating in year 2? Did most of 
these new participants attend job club? 

• Did experimental group members who completed job club in year 1 without 
finding employment participate in additional employment-related activities in 
year 2? Did participants attend additional job club sessions or switch to 
longer-term skill-building activities? 



,9 Infoimation provided by California Department of Social Services, Statistical Service Branch; U.S. Depart- 
ment of Health and Human Services (Administration for Families and Children) website, “Total TANF Families by 
State.” 

“California Department of Social Services (Information Services Bureau) website, “Public Assistance Facts and 
Figures: January 1998.” 
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• Did Jobs-First GAIN staff continue strongly enforcing the program’s manda- 
tory participation requirements? Did sanction rates increase in year 2? How 
often did program staff sanction experimental group members who had not in- 
curred a sanction in year 1 ? 

The report also looks at patterns of participation outside Jobs-First GAIN during the two- 
year follow-up period: 

• Did a substantial proportion of experimental and control group members at- 
tend employment-related activities outside Jobs-First GAIN on their own ini- 
tiative? In what types of activities did they participate? 

• Counting participation within Jobs-First GAIN and outside the program, did 
Jobs-First GAIN increase experimental group members’ use of employment- 
related services relative to control group members’? Did the program increase 
participation only in job club, its primary activity, or in other types of pre- 
employment activities as well? 

B. Costs 

• On average, how much did Jobs-First GAIN and other programs spend to pro- 
vide services, case management, and supportive service payments to experi- 
mental group members? 

• What was the program’s net cost — that is, what is the difference between the 
average cost for experimental group members and the average cost for control 
group members? 

• Was Jobs-First GAIN’S net cost comparable to the net cost of other Work First 
programs in California? Did Jobs-First GAIN have a smaller net cost than the 
earlier, basic-education-focused Los Angeles GAIN program? 

C. Impacts on Employment, Earnings, and Receipt of Public Assistance 

• Did Jobs-First GAIN sustain the year 1 boost in employment and earnings in 
year 2? 

• Did Jobs-First GAIN increase employment at jobs with full-time hours and 
medical coverage? 

• To what extent did Jobs-First GAIN reduce dependence on welfare and Food 
Stamp benefits? 

• Were short-term employment and earnings gains and welfare reductions larger 
for Jobs-First GAIN than for the earlier, basic-education-focused Los Angeles 
GAIN program and for other employment-focused programs? 

D. Impacts on Income. Self-Sufficiency, and Material Well-Being 

• Did Jobs-First GAIN increase the proportion of sample members who were 
working and off welfare at the end of year 2? 
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• Did the program make sample members better off financially? Did experimen- 
tal group members’ gains from earnings, estimated fringe benefits, and the 
EITC exceed their losses in public assistance? 

• Did Jobs-First GAIN increase the proportion of sample members who lived 
with another wage earner or with someone receiving income from other 
sources? 

• Did Jobs-First GAIN affect levels of medical coverage? 

• Did the program affect levels of food insecurity and hunger? 

E. Impacts on Child Care Use, Home Environment and Child Outcomes 

• Did Jobs-First GAIN affect the use and reliability of child care? 

• To what extent did experimental and control group members rely on child care 
that they paid for, subsidized care, and unpaid care from family and friends? 

• Did Jobs-First GAIN increase the likelihood of AFDC-FGs’ getting married 
or living with a boyfriend or partner? Did the program affect the likelihood of 
sample members’ having another child? 

• Did the program affect children’s academic performance, emotional and be- 
havioral adjustment, or safety? Did the effects vary by children’s age or gen- 
der? 

F. Impacts on Employment and Welfare for Key Subgroups 

A key task of the Jobs-First GAIN Evaluation is to analyze whether Los Angeles 
County’s Work First approach benefited many types of recipients or primarily certain subgroups 
of the caseload. Key subgroups for analysis include: 

• Inhabitants of different geographic areas of the county 

• Members of different racial/ethnic groups, and within these groups, people 
proficient or not proficient in English 

• People who entered the program with a high school diploma or a GED certifi- 
cate and nongraduates 

• Short- and long-term welfare recipients 

• People with or without a recent work history 

• People with multiple barriers to employment (for example, no high school di- 
ploma or GED certificate, no recent work history, and long-term welfare re- 
ceipt) 

• Among AFDC-FGs, early and regular enrollees 

• Among AFDC-Us, men and women 
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The last two subgroup analyses address specific questions concerning DPSS’s strategy 
for targeting services to particular types of welfare recipients. As discussed above, DPSS lacked 
the funding necessary to serve all welfare recipients mandated to participate in Jobs-First GAIN. 
Therefore, DPSS placed recipients on a waiting list, which was ordered according to recipients’ 
length of welfare receipt as well as other background characteristics. Most enrollees in Jobs-First 
GAIN entered the program after reaching the top of the waiting list and receiving a notice from 
DPSS informing them that a place in the program had become available. These people are called 
regular enrollees. Other enrollees asked DPSS for and were granted permission to enter the pro- 
gram early, that is, before they reached the top of the waiting list. These people are called early 
enrollees. Both early and regular enrollees were randomly assigned to the experimental and con- 
trol groups. Further, both early and regular enrollee experimental group members were subject to 
Jobs-First GAIN’S mandatory participation requirements and could incur a sanction for noncom- 
pliance. Including early enrollees in a random assignment study of Jobs-First GAIN allows the 
evaluation to address a long-standing question in welfare reform: When funds are scarce, should 
welfare-to-work programs target recipients who show the highest motivation to participate? 

Most previous studies of AFDC-Us in welfare employment programs focused only on 
household heads (usually men). In this evaluation, in contrast, the AFDC-U group consists of 
both primary wage earners (usually men) and second parents (usually women). The research de- 
sign, however, permitted only one adult member of an AFDC-U household to be included in the 
research sample: the first to show up for the program orientation. Nearly half of the AFDC-Us in 
the sample are women. Thus, the evaluation offers an unusual opportunity to investigate a wel- 
fare-to-work program’s effects on women in two-parent families. (What little research exists in- 
dicates that female AFDC-U recipients have scant prior earnings and tend not to benefit as much 
from welfare-to-work programs as their male counterparts.) 

The Jobs-First GAIN Evaluation began after California received a federal waiver elimi- 
nating regulations that terminated an AFDC-U case if the primary wage earner worked 100 hours 
or more in a month. This change affected all AFDC-Us, including control group members. Thus, 
studying the employment and earnings effects of Jobs-First GAIN for AFDC-U men (usually the 
primary wage earners) yields valuable information on the long-term impact of the elimination of 
this “100-hour rule.” The evaluation also tests whether a Work First program can increase em- 
ployment and earnings among primary wage earners who face no regulations limiting how much 
they can work. 

G. Comparisons with Other Programs 

Another key task of the evaluation is to compare the effects of Jobs-First GAIN with 
those of the three previously evaluated welfare-to-work programs below. 21 



2l For an evaluation of Los Angeles GAIN and Riverside GAIN, see Riccio, Friedlander, and Freedman, 1994, 
especially Tables 4.1 and 6.1. For an evaluation of Riverside LFA, see Hamilton et al., 1997, especially Table 9.4. 



• Los Angeles GAIN, the county’s basic-education-focused program, which 
served long-term recipients 22 during the late 1980s and early 1990s 

Most enrollees who participated in Los Angeles GAIN’S employment-related activities at- 
tended classes in ABE, ESL, or, less often, GED preparation. Relatively few participated in job 
search, unpaid work experience, or occupational skills training. The program’s emphasis on basic 
education conformed to statewide requirements to provide these services to welfare recipients who 
had not attained a high school diploma or a GED certificate, who scored below minimum levels on 
reading or math tests administered at program entry, or who were not proficient in English. Nearly 
everyone who entered Los Angeles GAIN during the late 1980s and early 1990s — 80 percent of 
AFDC-FGs and more than 90 percent of AFDC-Us — met at least one of these three criteria for 
needing basic education. 

An MDRC evaluation of Los Angeles GAIN found that, for AFDC-FGs, the program re- 
duced welfare expenditures to some extent, but did not raise earnings. The program had more posi- 
tive effects for AFDC-Us, although the earnings gain was still small, averaging less than $300 per 
enrollee per year. 

• Riverside County GAIN, a Work First, mixed-services program, operated 
in neighboring Riverside County during the late 1980s and early 1990s 

The Riverside GAIN program offered job search services to a large segment of the 
caseload, employed job developers to help move enrollees quickly into jobs, issued job placement 
goals for program staff, and encouraged enrollees to find work as soon as possible. All of these 
program features are consistent with a strong Work First approach. In keeping with statewide direc- 
tives, however, Riverside GAIN also offered basic education instruction as a first activity to enrol- 
lees determined to need it. Because of this combination of services, Riverside GAIN is sometimes 
referred to as a “mixed-services” program. An MDRC evaluation of the program found unprece- 
dented employment and earnings increases and welfare savings. 

• The Riverside GAIN Labor Force Attachment (LFA) program, a Work 
First, job-search-first program, operated in Riverside County in the early 
to mid-1990s; nearly all enrollees were placed immediately into job 
search activities 

As part of a national evaluation of welfare-to-work programs in the early 1990s, the Na- 
tional Evaluation of Welfare-to-Work Strategies, Riverside County welfare administrators oper- 
ated two versions of the GAIN program simultaneously to determine which approach worked 
better. The first version used a Human Capital Development (HCD) program model, in which 
participants received education and training services to upgrade their skills prior to seeking work. 
The HCD objective was to prepare people for jobs that offered sufficient wages and benefits to 
get them and keep them off welfare. The second version of Riverside GAIN employed a Labor 
Force Attachment (LFA) program model. LFA placed enrollees (even those who had not gradu- 
ated from high school or attained a GED certificate or who were determined to have low literacy 
or math skills) immediately in job search activities, advocating quick exposure to and entry into 



u Los Angeles GAIN enrolled welfare recipients who had received assistance continuously for at least 
three years. 
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the labor market as the best route to earnings increases, job advancement, and self-sufficiency. 
Recent evaluations of Riverside LFA have found that the program produced larger earnings gains 
and welfare savings than many education-focused programs, including Riverside HCD and Los 
Angeles GAIN. Its effects were not as large, however, as those attained by the previous employ- 
ment-focused, mixed-services Riverside GAIN program. 

As discussed in the first report on the Jobs-First GAIN Evaluation, DPSS administrators 
consulted with their counterparts in Riverside County when designing Jobs-First GAIN in the 
mid-1990s. Sharing Riverside’s growing commitment to the Work First approach, DPSS admin- 
istrators adopted several features of the Riverside LFA program (some of which, such as the use 
of job developers and encouragement of quick entry into the job market, were also part of River- 
side GAIN). Other features, such as Riverside’s strong emphasis on placement goals for program 
staff, were not incorporated into Jobs-First GAIN. 

The similarities between Los Angeles Jobs-First GAIN and Riverside LFA in their wel- 
fare-to-work approach and their operation under the same statewide welfare regulations make 
comparisons between them particularly meaningful. 

H. Cost-Effectiveness 

• Did Jobs-First GAIN realize savings in public assistance and associated ad- 
ministrative expenses and lead to increases in tax revenues? Did these benefits 
to government budgets exceed the higher costs of services for experimental 
group members? 

• Was Jobs-First GAIN more cost-effective than the previous, basic-education- 
focused GAIN program? Were the results as positive as those attained by 
other employment-focused programs, such as Riverside GAIN? 

I. Looking Toward CalWORKs 

Studies of CalWORKs are still in an early phase. It remains to be seen whether DPSS’s 
strategy of combining Jobs-First GAIN’S services and pro-work message with welfare time lim- 
its, stronger financial incentives to work, special services, and post-employment services will 
produce larger boosts in employment and larger reductions in welfare dependency. The present 
evaluation may provide important context for future studies, however, by examining both the 
successes and limitations of Jobs-First GAIN. If the program led to large increases in stable em- 
ployment with high earnings, self-sufficiency, and material well-being, the need for additional 
services and incentives may not be great. Alternatively, if many experimental group members 
remained poor and on welfare, despite the program’s employment and earnings gains, additional 
services and supports would likely be warranted. Questions of interest include: 

• Did Jobs-First GAIN increase employment stability or increase employment 
by moving people into jobs that they quickly lost? 

• At the end of year 2, were most experimental group members still receiving 
welfare benefits? Were most experimental group members who were working 
also receiving assistance? 
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• Did Jobs-First GAIN increase use of subsidized child care or transitional 
Medi-Cal? 

• Did the program increase experimental group members’ incomes sufficiently 
to lift their families out of poverty? 



VIII. Data Sources for This Report 

A. GEARS Automated Appraisal and Program Tracking Records 

Sample members’ background characteristics were recorded by Jobs-First GAIN staff 
during orientation and appraisal meetings and entered into the GAIN Employment Activity and 
Reporting System (GEARS). These background data, which are available for all sample mem- 
bers, are used to divide the sample into key subgroups. Most of the data, including educational 
attainment status and length of prior welfare receipt, are self-reported by sample members, al- 
though some, such as date of birth, were transferred automatically from DPSS’s automated wel- 
fare eligibility and payment system, the Integrated Benefit Payment System (IBPS). 

GEARS also supplied data on experimental group members’ use of Jobs-First GAIN ser- 
vices, the frequency with which they entered nonmandatory status, and the likelihood of their 
encountering the program’s formal enforcement procedures, including financial sanctions. More- 
over, GEARS records permitted estimation of experimental group members’ length of stay in 
program activities. At least two years of follow-up data are available for all experimental group 
members. 

B. GEARS Supportive Service Records 

The GEARS system also supplied two years or more of data on DPSS supportive services 
payments for child care, transportation, and ancillary expenses for supplies such as books, cloth- 
ing, and protective equipment. As noted earlier, experimental and control group members were 
eligible to receive payments, and payments for both groups were recorded in GEARS. 

C. Statewide Unemployment Insurance Earnings Records 

Employment and earnings impacts were computed using automated statewide Unem- 
ployment Insurance (UI) records data from California’s Employment Development Department. 
Data for eight quarters, or two years, are available for all sample members, starting with the first 
calendar quarter after random assignment — that is, from quarter 2 through quarter 9. (UI earn- 
ings records for quarter 1 , which includes the date of random assignment, are excluded from the 
analysis because they may contain earnings from employment that occurred before random as- 
signment.) Recorded statewide, UI earnings can be used to make reasonably accurate and unbi- 
ased measures of employment, including earnings within California but outside of Los Angeles 
County. Data are not available for out-of-state earnings or for work not usually covered by the UI 
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system, such as self-employment, domestic service, informal child care, and work “off the 
books” or for employers who do not report earnings. 23 

D. Automated AFDC/TANF and Food Stamp Payment Records 

Impacts on receipt of AFDC/TANF and Food Stamps were calculated using automated 
payment records from DPSS’s EBPS. Two years of follow-up data are available for all sample 
members. Because California’s counties maintain separate payment systems, the IBPS analysis 
misses payments to sample members who moved to other counties in the state and received wel- 
fare or Food Stamps there. As discussed in Chapter 5, calculations from statewide Medi-Cal eli- 
gibility data suggest that this problem did not affect the impact findings. Less than 5 percent of 
sample members received a payment elsewhere in California during the two-year follow-up pe- 
riod. Further, Jobs-First GAIN did not cause more experimental or control group members to 
move out of Los Angeles County and go on assistance. 

E. Automated Medi-Cal Eligibility Records 

Impacts on receipt and costs of Medi-Cal benefits were estimated from California’s 
statewide eligibility records in the Medi-Cal Eligibility Determination System (MEDS). Two 
years of follow-up data are available for all sample members. MEDS data were also used to esti- 
mate Jobs-First GAIN’S program effects on receipt of Supplemental Security Insurance (SSI) and 
receipt of AFDC/TANF benefits in counties other than Los Angeles. 

Although the MEDS system provides both payment and eligibility information on every 
adult and child covered by Medi-Cal, MDRC collected eligibility information only for the sam- 
ple member. 24 To estimate the program’s impacts on Medi-Cal costs, MDRC used published data 
on Medi-Cal expenditures and assumptions about the number of people covered per month. 

F. Two-Year Client Survey 

This report also presents analyses of the Two-Year Client Survey, which was adminis- 
tered to a subsample of 746 single-parent (AFDC-FG) experimental and control group members 
about two years after random assignment (see Table 1.3). MDRC selected survey respondents 
from each month during which new sample members joined the program, but excluded male sin- 
gle parents and sample members not proficient in English or Spanish. A stratified random sample 
was chosen. About 80 percent of people in the survey sample were regular enrollees and 20 per- 
cent were early enrollees. As intended, these proportions closely match the proportions of these 
two groups in the lull sample. Just over 74 percent of sample members chosen completed the 
survey. 

Interviews for the Two-Year Client Survey were conducted in English or Spanish. Survey 
respondents were asked about their participation in employment-related activities within and out- 
side Jobs-First GAIN since random assignment; educational attainment; employment history; 
household structure and income; medical coverage and receipt of noncash benefits; level of food 



“Some earnings missed by the UI system may be captured by the self-reported earnings and employment data 
recorded in the Two-Year Client Survey. 

24 These limitations lead to underestimation of use of SSI benefits when the SSI recipient was a child or disabled 
spouse. 
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insecurity and hunger; use of child care for employment and for other reasons; and indicators of 
their children’s school progress, emotional and behavioral well-being, and safety. 

Data from the Two-Year Client Survey provide information on topics not covered by ad- 
ministrative data, such as use of program services outside Jobs-First GAIN by experimental and 
control group members. The survey data also fill in gaps in administrative data, such as participa- 
tion in employment-related activities outside Jobs-First GAIN and employment at jobs not cov- 
ered by the statewide UI system. Some of the survey data overlap with administrative data, and 
for several reasons, results calculated from the two sources may differ. First, survey respondents 
may have provided incorrect start or end dates when asked to recall participation or employment 
that occurred during the early months of follow-up. In addition, some respondents may have been 
reluctant to provide information on employment and income that can be found in administrative 
records. In other cases, survey data may be more accurate. For example, earnings that employers 
failed to report or inaccurately reported to the UI system may be captured by the survey. 

G. Statewide and County Reports and Fieldwork and Interviews with 
Administrators and Staff 

The descriptions of Los Angeles GAIN, Jobs-First GAIN, and CalWORKs reported 
above were based on site visits and observations of program operations, discussions with pro- 
gram administrators and staff, agency memos and directives supplied by DPSS, and calculations 
from tables in agency reports. Agency reports and expenditure data were also used in the benefit- 
cost calculations presented in this report. 



IX. The Contents of This Report 

Chapter 2 examines experimental and control group members’ use of program services 
and estimates the impacts of Jobs-First GAIN on participation. The chapter also examines the 
extent to which experimental group members encountered Jobs-First GAIN’S formal enforce- 
ment procedures. Chapter 3 presents the average costs of providing employment-related services 
to experimental and control group members and calculates the experimental-control difference in 
cost, or net cost, of Jobs-First GAIN. Chapter 4 discusses the program’s impacts on employment 
rate, earnings, and AFDC/TANF and Food Stamp receipt for single-parent (AFDC-FG) sample 
members, including the impacts for key subgroups. These results are then compared with those 
achieved by the earlier Los Angeles GAIN program and several other employment-focused wel- 
fare-to-work programs. Chapter 5 examines Jobs-First GAIN’S impacts on indicators of income, 
self-sufficiency, access to medical coverage, and material well-being for AFDC-FG sample 
members. Chapter 6 summarizes the program’s effects on child care use, costs, and reliability; 
household composition; and child outcomes for AFDC-FG sample members. Chapter 7 presents 
the two-year impacts of Jobs-First GAIN on employment, earnings, and receipt of AFDC/TANF 
and Food Stamps for two-parent (AFDC-U) sample members and key subgroups thereof. Finally, 
Chapter 8 presents the results of a benefit-cost analysis of Jobs-First GAIN from the perspectives 
of experimental group members and the government budget. 
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Chapter 2 

Participation in Employment-Related Activities 
After Random Assignment 



This chapter analyzes the use of program services by sample members in the Jobs-First 
GAIN Evaluation during the two years after random assignment. First, the chapter explores the 
extent to which AFDC-FG experimental group members were exposed to the mix of services and 
messages offered by Jobs-First GAIN. As discussed in Chapter 1, the Jobs-First GAIN program 
ran high-quality job clubs supported by job development activities, as well as short-term educa- 
tion and training for people who completed job club without finding employment. These activi- 
ties made up a key component of the Jobs-First GAIN approach to promoting rapid entry into the 
labor market. This chapter also examines the extent to which program staff used formal enforce- 
ment procedures, especially financial sanctions (reductions in welfare grants), to enforce manda- 
tory participation requirements. Further, it compares levels of participation for subgroups of the 
experimental group. 

The chapter then examines the extent to which AFDC-FG experimental group members 
participated in employment-related activities outside Jobs-First GAIN. Such participation could 
have occurred when experimental group members were no longer required to participate in the 
program or had exited from welfare, or when they were still in Jobs-First GAIN as an addition to 
or instead of participation in their regularly assigned activities. Next, the chapter compares par- 
ticipation patterns for AFDC-FG experimental group members with those for members of the 
control group to estimate the effects of Jobs-First GAIN on use of employment-related services. 
The chapter concludes with a brief summary of participation patterns for AFDC-U experimental 
group members. 



I. Key Findings 

• All experimental group members attended Jobs-First GAIN’S six-hour infor- 
mational and motivational orientation session and were exposed to the pro- 
gram’s strong pro-work message. 

• Relatively few experimental group members — 42 percent of AFDC-FGs and 
34 percent of AFDC-Us — participated in a subsequent Jobs-First GAIN ac- 
tivity during the two years after orientation. Of those who participated, nearly 
all attended job club, reflecting the Work First character of the program. 
Nearly all participants began attending activities soon after orientation and fin- 
ished participating by the end of year 1. 

• About 30 percent of AFDC-FG experimental group members experienced a 
reduction in their welfare grant (a sanction) for noncompliance with Jobs-First 
GAIN’S mandatory participation requirements at least once within two years 
of orientation. This sanction rate was high compared to the sanction rates re- 
corded for other employment- focused programs in the 1990s and well above 
those recorded for welfare-to-work programs evaluated in the 1980s. Jobs- 
First GAIN case managers cited most other AFDC-FG and AFDC-U experi- 
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mental group members for noncompliance and initiated formal enforcement 
procedures on them at some point during the follow-up period. The process, 
however, did not lead to imposition of financial sanctions for these people. 

• A relatively large proportion of AFDC-FG experimental group members at- 
tended education and training activities outside Jobs-First GAIN, boosting 
their rate of participation in any type of employment-related activity other 
than Jobs-First GAIN orientation to 62 percent. 

• About 44 percent of AFDC-FG control group members also participated in 
employment-related activities, mostly education and training, on their own ini- 
tiative. As a result of this unusually high participation rate for control group 
members, the experimental-control difference in participation was modest 
(about 1 8 percentage points). 

• Jobs-First GAIN produced a much larger impact (31 percentage points) on 
participation in job search. In effect, Jobs-First GAIN induced many experi- 
mental group members to participate in job search who would otherwise have 
participated in education and training. 



II. Framework for Interpreting Participation Findings 

A. What Can Be Learned from Studying Participation 

The discussion of participation patterns for sample members presented in this chapter will 
provide important context for interpreting the findings on program costs, impacts, and benefits in 
the chapters that follow. The first task in the participation analysis is to measure the extent of ex- 
perimental group members’ involvement in Jobs-First GAIN. When the evaluation was designed, 
it was expected that restricting access to Jobs-First GAIN’S services, messages, and mandates to 
the experimental group would enable its members to attain a higher rate of employment, higher 
earnings, and lower levels of welfare receipt than their counterparts in the control group. 
Whether these effects actually occur depends on many factors. A key question addressed by this 
chapter is whether experimental group members’ exposure to the program was sufficient to 
change their labor market behavior. Put differently, for this to be a fair test of the program’s 
Work First strategy, a relatively high percentage of experimental group members must have par- 
ticipated in Jobs-First GAIN activities, encountered its mandates, or received its messages. 

Participation in Jobs-First GAIN was not the only way in which experimental group 
members could prepare for work. Some may have participated in other types of activities on their 
own initiative, probably after they were no longer required to participate in Jobs-First GAIN. 
These experiences outside the program could also have affected the timing of experimental group 
members’ search for employment, success in finding and keeping jobs, and levels of income and 
self-sufficiency. It is therefore important to learn how often experimental group members partici- 
pated in employment-related activities outside Jobs-First GAIN. 

Further, previous experimental evaluations of welfare-to-work programs have shown that 
many control group members enroll in employment-related activities — typically, basic educa- 
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tion, vocational training, or post-secondary education — on their own initiative. 1 Jobs-First 
GAIN’s effects on employment and welfare will likely fall short of expectations if control group 
members received similar types of pre-employment services as experimental group members or 
took part in other activities that enhanced their ability to find and keep jobs. For this reason, it is 
important to measure control group members’ levels of participation and to estimate Jobs-First 
GAIN’s incremental effects on participation — that is, the extent to which the program raised 
experimental group members’ level of participation (overall and in particular activities) above 
that of control group members. 

The same reasoning applies to the study of Jobs-First GAIN’s cost-effectiveness. Federal, 
state, and county government budgets not only funded Jobs-First GAIN services, but also many 
of the activities in which experimental and control group members enrolled on their own initia- 
tive — through the federal Job Training Partnership Act (JTPA), community colleges, Pell 
grants, and state and county education programs. Thus, the total cost to government budgets of 
helping Jobs-First GAIN experimental group members prepare for work depends on experimen- 
tal group members’ level of participation in pre-employment activities both within and outside 
the program. Moreover, estimating the experimental-control difference in pre-employment costs 
requires knowledge of participation levels for control group members. 

B. Alternative Definitions of Participation 

This chapter follows the analytical framework used in previous MDRC studies of partici- 
pation patterns in welfare-to-work programs. It defines participation as attendance at an employ- 
ment-related activity for at least one day, whether within or outside Jobs-First GAIN, but does 
not count program orientations, appraisals, or other meetings with Jobs-First GAIN staff. This 
definition of participation assumes that program enrollees who take part in activities such as job 
clubs or education and training courses receive the most exposure to the program “treatment.” 
For Jobs-First GAIN, however, the distinction between attendance at a program activity and a 
meeting with program staff is not clear-cut. As discussed in the previous chapter, all experimen- 
tal group members attended a long informational and motivational meeting at orientation during 
which program staff strongly communicated the program’s Work First message. In addition, ex- 
perimental group members could receive job leads from program staff during orientation, ap- 
praisal, or at any time afterward. Thus, by a more inclusive definition of a program activity, one 
could conclude that 100 percent of experimental group members participated. 

C. Employment-Related Services Are Only Part of the “Treatment” 

Participation in employment-related activities was only one of several ways in which 
program enrollees could experience the Jobs-First GAIN “treatment.” Equally important, pro- 
gram administrators and staff communicated a strong Work First message to all people entering 
the program. Enrollees first heard this message during a long motivational session at program 
orientation. Program staff repeated these ideas during appraisals and other one-on-one meetings, 
during program activities such as job club, and in informational handouts. 

Further, as discussed below, DPSS implemented a tough enforcement-oriented response 
to experimental group members who did not participate in program activities without showing 

'See, for example, Riccio et al., 1994, pp. 38-46; Hamilton et al., 1997, pp. 125-130; and Scrivener et al., 1998, 
pp. 62-64. 
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good cause. Jobs-First GAIN staff frequently issued warnings to experimental group members 
that they were not complying with the program’s mandatory participation requirements and im- 
posed financial sanctions (welfare grant reductions) on a relatively large proportion of the 
caseload at least once within two years of orientation. Program administrators intended this 
“high-enforcement” case management approach and the strong pro-employment message to 
complement the program’s high-quality, motivational job clubs. Together, these components of 
the Jobs-First GAIN approach encouraged enrollees to find work quickly and discouraged them 
from spending a long time in the program. 

D. Measurement Issues 

Sample members’ participation in Jobs-First GAIN and non-Jobs-First GAIN activities 
was measured over a two-year follow-up period, starting with their date of random assignment. 
(For experimental group members this date is the date of orientation.) Automated program track- 
ing records from DPSS’s GAIN Employment Activity Reporting System (GEARS), combined 
with automated welfare and earnings records, were used to estimate rate and length of participa- 
tion in Jobs-First GAIN activities. The same measures of participation in non-Jobs-First GAIN 
activities were calculated from the responses of a sample of 746 AFDC-FG experimental and 
control group members to the Two-Year Client Survey. Survey respondents reported the start and 
end months and average number of hours per week of participation. Like any self-reported data, 
these participation data are subject to recall error. That is, some respondents may not have re- 
ported participation in all activities in which they in fact participated, especially short-term ac- 
tivities, whereas others may have reported participation in activities that occurred prior to ran- 
dom assignment. 2 Some respondents may also have underestimated or overestimated the duration 
of their attendance or the average number of hours per week of participation. 

Some measures presented in this chapter apply only to sample members who participated 
in an employment-related activity (that is, job club, education, or training). These people will be 
referred to as participants. The findings for AFDC-FGs represent weighted averages of the par- 
ticipation levels estimated for regular and early enrollees. 3 



Participation data from GEARS and from survey responses were compared for the 372 experimental group 
members in the survey sample. Respondents were considered to have participated in a non-Jobs-First GAIN activity 
if participation was recorded on the survey but not on GEARS. If participation was recorded only on GEARS, the 
mismatch was attributed to recall error. For each Jobs-First GAIN activity recorded on GEARS, a third or more of 
experimental group members in the survey sample did not report participation when interviewed. For this analysis it 
was assumed that some experimental and control group members did not report their participation in non-Jobs-First 
GAIN activities. It was also assumed that the rate of recall error for non-Jobs-First GAIN activities, which respon- 
dents attended on their own initiative, was lower than for Jobs-First GAIN activities. Accordingly, reported partici- 
pation rates in non-Jobs-First GAIN activities were adjusted upward by a small amount to compensate for recall 
error. See footnote 13 for more details. 

As shown in Table 1.3, a smaller percentage of early enrollees than regular enrollees were randomly assigned 
to the control group. To compensate for this imbalance, results for early and regular enrollees were weighted ac- 
cording to the proportion of the combined sample of experimental and control group members for which they ac- 
count. 





- 35 - 



III. Results for AFDC-FGs 



A. Participation by Experimental Group Members in Jobs-First GAIN Activities 

As shown in Table 2.1, in the two-year follow-up period, 58 percent of AFDC-FG ex- 
perimental group members were assigned to a Jobs-First GAIN job search, education, or training 
activity, and 42 percent participated in a Jobs-First GAIN activity for at least one day. The level 
of participation in Jobs-First GAIN activities for experimental group members is low compared 
to the participation levels recorded for other employment-focused welfare-to-work programs 
evaluated by MDRC, including Riverside GAIN (60 percent). The Riverside Labor Force At- 
tachment (LFA) program, however, had a similar proportion of experimental group members (44 
percent) who participated in work-related activities. 4 Jobs-First GAIN also attained a lower level 
of participation than the earlier, education-focused Los Angeles GAIN program (5 1 percent). 5 

On average, AFDC-FG participants remained in Jobs-First GAIN activities for a rela- 
tively short time — a little more than four out of the 24 months of the follow-up period (see Ta- 
ble 2.2). About 60 percent attended for two months or less. Nearly all participants began attend- 
ing activities soon after orientation and finished participating by the end of year 1 . At the high 
end, 8 percent participated for at least a year; a slightly higher percentage were still attending a 
Jobs-First GAIN activity at the end of the follow-up period. The participation patterns displayed 
in Table 2.1 reflect the Work First orientation of Jobs-First GAIN. Out of all activities, job 
search (usually job club) drew the largest percentage of experimental group members (37 per- 
cent). In contrast, only 1 1 percent of experimental group members participated in basic education 
or vocational training. 6 DPSS did not assign any Jobs-First GAIN enrollees to post-secondary 
education courses. 

The data in Table 2.2 provide additional information on use of program services for the 
42 percent of experimental group members who attended a Jobs-First GAIN activity. As ex- 
pected of a Work First program, nearly 90 percent of AFDC-FG participants attended job club in 
the two-year follow-up period, whereas only about a quarter of them participated in education or 
training. A little more than three-fourths of job club participants attended only one “spell” of job 
club (that is, one block of consecutive weeks), and nearly as many took part in job club as their 
only activity in the program. 



4 See Hamilton and Friedlander, 1989, Table 3.1, p. 38 (San Diego Saturation Work Initiative Model [SWIM]); 
Riccio et al., 1994, Table 2.1, p. 26 (Riverside GAIN); Kemple, Friedlander, and Fellerath, 1995, Table 3.2, p. 46 
(Florida Project Independence); Hamilton et al., 1997, Table 5.1, p. 110 (Atlanta, Grand Rapids, and Riverside La- 
bor Force Attachment [LFA]); and Scrivener et al., 1998, Table 3.1, p. 50 (Portland JOBS). Two-year participation 
rates for these employment-focused programs ranged from 43.8 percent (Riverside LFA) to 73.8 percent (Atlanta 
LFA). These estimates include all sample members for whom participation data were collected and do not control 
for sample members’ background characteristics. 

5 Riccio et al., 1994, Table 2.1, p. 26. The low Jobs-First GAIN assignment and participation rates resulted in 
part from the fact that 13 percent of experimental group members received exemptions (recommendations that 
their mandatory participation status be terminated) during their initial appraisal meetings because case managers 
determined that they no longer met the criteria for being considered mandatory for the program. Case managers 
later deregistered virtually all these people from the program. See Freedman, Mitchell, and Navarro, 1999, pp. 
28, 47-48, and footnote 10. 

6 Basic education activities include English as a Second Language (ESL), Adult Basic Education (ABE), prepa- 
ration for the General Educational Development (GED) certificate test, and high school. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 2.1 

Rates of Participation and Status Within Two Years of Orientation 
for AFDC-FG Experimental Group Members 



Participation Status (%) 


All 


Regular 

Enrollees 


Early 

Enrollees 


Assigned to any activity 8 


58.3 


54.7 


72.4 


Ever participated in b 








Any activity 0 


41.9 


37.9 


57.0 


Job search 


37.1 


33.8 


49.6 


Any education or training 


10.6 


8.8 


17.5 


Basic education 


4.3 


3.2 


8.3 


ESL 


1.2 


1.0 


2.2 


ABE 


1.1 


0.9 


1.8 


GED 


1.6 


1.2 


3.3 


High school 


0.5 


0.3 


1.2 


Vocational training 


7.6 


6.6 


11.6 


Work experience 


2.8 


2.3 


4.6 


OJT 


0.0 


0.0 


0.1 


Assessment 


9.6 


8.4 


14.0 


Deregistered for any reason d 


93.9 


93.3 


95.9 


For employment 


48.3 


47.4 


51.9 


For sanction 


39.1 


39.0 


39.5 


For other reason 


46.3 


46.5 


45.4 


In conciliation 


83.0 


83.1 


82.6 


Sanctioned 


30.4 


30.9 


28.5 


Deferred for any reason 


30.5 


31.6 


26.4 


For unapproved SIT 0 


8.5 


9.1 


6.3 


Sample size 


11,521 


8,620 


2,901 



SOURCE: MDRC calculations using data from the GAIN Employment Activity and Reporting System 
(GEARS). 

NOTES: 

“The assignment rate includes assignment to all activities listed, except assessment. 

b Activity participation rates include participation for at least one day in either a program-referred or 
approved self-initiated activity. 

c "Any activity" includes all activities listed, except assessment. 

d Subgroup percentages sum to more than the total deregistration percentage because some recipients 
were deregistered more than once during the follow-up period. 

e An SIT is a self-initiated activity ("self-initiated training"). 
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Los Angeles Jobs-First GAIN Evaluation 

Table 2.2 

Participation Patterns Within Two Years of Orientation for AFDC-FG 
Experimental Group Members Who Participated in Jobs-First GAIN Activities 



Outcome 




Participated in job search (%) 


88.5 


One spell 


68.0 


Two or more spells 


20.5 


Participated in (%) a 


Job search only 


74.2 


Education and training only 


10.8 


Job search and education and training 


14.4 


Average number of months in which 
individuals participated in a Jobs-First 


GAIN activity 6 


4.2 


Number of months in which there was 
participation (%) c 


1 


32.5 


2 


27.0 


3 


8.7 


4 to 6 


11.3 


7 to 12 


11.9 


1 3 or more 


8.3 


Still participating at end of year 2 (%) 


9.0 


Sample size 


4,509 



SOURCE: MDRC calculations from the GAIN Employment Activity and Reporting System (GEARS). 

NOTES: Full sample mean and percentages are weighted averages of results for regular and early enrollees. 

Measure = (regular enrol lee result x percent of experimental and control group regular enrollees in 
AFDC-FG sample) + (early enrollee result x percent of experimental and control group early enrollees in AFDC- 
FG sample). 

®The percentage of participants who participated only in work experience or OJT is not shown in the 

table. 

Participants for whom data are missing were excluded from the calculation of the mean. 
c Subgroup percentages do not sum to 100 percent because of missing data. 
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B. Granting Temporary Deferrals and Longer-Term Deregistrations 
from Mandatory Participation Requirements 

Almost every experimental group member experienced the transition to nonmandatory 
status, that is, was deregistered from the program, at least once before the end of year 2. As 
shown in Table 2.1, 94 percent of experimental group members were deregistered within two 
years of random assignment, about half of them because they were working full time, that is, for 
at least 30 per hours per week. 7 

Under California regulations effective prior to April 1, 1998, welfare recipients with cer- 
tain barriers to participation were temporarily excused, or deferred, from Jobs-First GAIN’S par- 
ticipation requirements. Common reasons for granting deferrals included medically verified ill- 
ness and “severe family crisis.” As shown in Table 2.1, about 31 percent of AFDC-FGs were 
deferred from participation in Jobs-First GAIN for good cause at some point during follow-up. 

Notably, about 9 percent of experimental group members received a deferral for an unap- 
proved self-initiated activity, usually an education or training activity that experimental group 
members began attending on their own initiative prior to orientation that did not meet program 
requirements for promoting quick entry into jobs. Jobs-First GAIN staff granted enrollees a tem- 
porary deferral to complete their current semester of coursework, after which enrollees were sup- 
posed to be assigned to job club. DPSS staff did not monitor enrollees’ attendance at these unap- 
proved activities closely and did not provide support service payments to participants in them. In 
this analysis, as in DPSS’s published reports, these unapproved activities were not counted in 
calculations of participation rates in Jobs-First GAIN activities. 

C. Use of Formal Enforcement Procedures and Sanctioning 

A Jobs-First GAIN program enrollee who failed to attend her assigned activity received a 
notice outlining the sanctions that would be applied if the problem continued. If she did not com- 
ply at that point, a conciliation process was initiated in which she was given another notice and 
another opportunity to resolve the problem. If the enrollee continued to fail to comply, she in- 
curred a sanction, that is, a reduction in her welfare grant amount equal to the value of benefits 
for one person on the case. 8 The first sanction remained in effect until the enrollee met with pro- 
gram staff and agreed to attend a program activity or convinced program staff that she had good 
cause for not participating. A second sanction lasted a minimum of three months, and subsequent 
sanctions at least six months, even if the enrollee resumed participation sooner. 

The data in Table 2.1 demonstrate that Jobs-First GAIN case managers used formal en- 
forcement procedures very often, although the process only sometimes resulted in imposition of a 
financial sanction. As shown, 83 percent of experimental group members entered the conciliation 
process at least once during follow-up, either because they did not show up for an assigned activ- 
ity or a scheduled meeting with Jobs-First GAIN staff or because they stopped attending a pro- 
gram activity without good cause. The proportion ever in conciliation exceeds the proportion 
ever assigned to an activity because the conciliation rate includes conciliation for failure to show 



7 See Freedman, Mitchell, and Navarro, 1999, Chapter 3, pp. 44-50, and Appendix Tables C.2-C.6, pp. 135-140, 
for more detailed information on experimental group members who entered nonmandatory status after random as- 
signment. 

8 Weissman, 1997, p. 66. 
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up at deferral reviews or at scheduled appraisal meetings following a deregistration. Some ex- 
perimental group members who refused to accept an assignment to job club also entered concilia- 
tion status during their initial appraisal meeting following random assignment. 

About 30 percent of AFDC-FGs incurred a sanction in the two-year follow-up period. 
The sanction rate for Jobs-First GAIN exceeds those for the earlier Los Angeles GAIN, Riverside 
GAIN, and Riverside LFA programs (all with sanction rates of less than 10 percent) by a wide 
margin. Some employment-focused welfare-to-work programs operating in the 1990s, however, 
sanctioned comparably large proportions of enrollees. 9 Most of the experimental group members 
sanctioned in Jobs-First GAIN (23 percent) entered that status during the first year of the follow- 
up period. In year 2, Jobs-First GAIN staff continued to enforce the program’s mandatory par- 
ticipation requirements for those still in the program and sanctioned an additional 8 percent of 
experimental group members for noncompliance. In addition, some experimental group members 
who were first sanctioned in year 1 remained in that status for one or more months in year 2. 

D. Participation Patterns for Key Subgroups 

1. Regular and early enrollees. As discussed in the previous chapter, early enrollees 
asked DPSS to enroll them in Jobs-First GAIN before they reached the top of the waiting list for 
services, whereas regular enrollees waited until DPSS required them to enter the program. It was 
expected, therefore, that a higher percentage of early enrollees would participate in employment- 
related activities. Participation patterns for these two subgroups confirm this hypothesis. As 
shown in Table 2.1, the rates of activity assignment and participation for early enrollees ex- 
ceeded those for regular enrollees by a wide margin. In the two-year follow-up period, program 
staff referred 72 percent of early enrollees to a Jobs-First GAIN activity, compared to 55 percent 
of regular enrollees. The overall participation levels of early and regular enrollees, 57 percent and 
38 percent, respectively, reflect this difference in assignment rate. A larger proportion of early 
enrollees than regular enrollees participated in every specific type of activity: 50 percent versus 
34 percent went to job search, and 18 percent versus 9 percent attended an education or training 
activity. These differences most likely reflect early enrollees’ greater motivation to participate. 
Surprisingly, the same percentage of early and regular enrollees entered the conciliation process 
(83 percent), and a similar proportion incurred a sanction (29 percent and 31 percent, respec- 
tively). 10 



2. Educational attainment, prior employment, and prior welfare receipt Jobs- 
First GAIN produced relatively consistent levels of participation for sample members who dif- 
fered in education, employment history, and previous welfare receipt (see Table 2.3). For in- 
stance, about 35 percent of high school graduates and GED recipients and 39 percent of non- 
graduates participated in job club during the two years after random assignment; around 10 
percent of each group attended an education or training activity. Similar results were observed 
for sample members who worked for pay and for those who did not work for pay in the year be- 

9 

Sanction rates over a two-year follow-up period ranged from 9 percent for the Riverside LFA program to 42 
percent for the Grand Rapids, Michigan, LFA program. Atlanta, Georgia’s LFA program and Portland JOBS each 
sanctioned about 20 percent of its enrollees. See Hamilton et al., 1997, Table 5.3, p. 1 15; and Scrivener et al., 1998, 
Table 3.3, p. 54. 

One reason why early enrollees received as many sanctions for noncompliance as regular enrollees, despite 
having volunteered to participate, may be that they thought they had volunteered to participate in the previous, ba- 
sic-education-focused GAIN program and objected to being assigned to job club (see Weissman, 1997, p. 42). 
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fore random assignment, and for recent applicants for welfare, short-term recipients, and long- 
term recipients. The consistency of these results once again reflects the Work First focus of Jobs- 
First GAIN. Experimental group members without a high school diploma or GED certificate in 
the earlier evaluation of Los Angeles GAIN, in contrast, were five times more likely to attend 
basic education classes than job clubs." 

3. GAIN region, racial/ethnic group, and level of English proficiency. Participa- 
tion levels varied by race/ethnicity and by GAIN region (see Table 2.3). For instance, about half 
of experimental group members in the Central and Southeastern regions took part in a Jobs-First 
GAIN activity, usually job club, compared with around 35 percent in the outlying northern re- 
gions of San Fernando Valley and San Gabriel Valley. Participation levels were highest among 
African-American and Hispanic experimental group members (46 percent for both groups) and 
markedly lower among whites and Asians (32 percent and 24 percent, respectively). 

Participation levels varied only slightly between Hispanics with and without proficiency 
in English (see Table 2.3), in large part because DPSS offered job clubs in Spanish. In keeping 
with the Work First philosophy of the program, Jobs-First GAIN staff assigned most people 
without English proficiency to job club rather than to English as a Second Language (ESL) 
classes — unlike in the previous, education-focused GAIN program. In contrast, a higher per- 
centage of whites with English proficiency (34 percent) than those without it (13 percent) at- 
tended Jobs-First GAIN activities. A similar pattern was seen among Asian experimental group 
members. DPSS operated job clubs in Armenian and in Vietnamese and other Southeast Asian 
languages, so it is not immediately clear why these differences were observed. 

Interestingly, sanction rates were consistently higher for experimental group members 
who were proficient in English than for those who were not (see Table 2.3). Among AFDC-FGs 
who were proficient in English, more than 30 percent of whites, African-Americans, and Hispan- 
ics and close to 20 percent of Asians incurred a sanction during the follow-up period. In com- 
parison, sanction rates for experimental group members who were not proficient in English 
ranged from 14 percent (Asians) to 19 percent (Hispanics). Again, it is not clear why these dif- 
ferences occurred. 12 

E. Participation in Activities Outside Jobs-First GAIN 

As discussed above, enrollees in welfare-to-work programs often participate in pre- 
employment activities on their own initiative. Typically, they enroll in these activities after enter- 
ing nonmandatory status or leaving welfare. Less commonly, people attend alternative employ- 
ment-preparation activities when still required to participate in their program — either during 
deferrals for an unapproved self-initiated activity (discussed above) or without the knowledge of 



See Riccio et al., 1994, Table C.5, p. 312. As shown in Table C.5, the percentage of high school graduates and 
GED recipients who participated in job club was roughly equal to that who participated in education or training. 

Sample members not proficient in English include recent immigrants and refugees. It is possible that Jobs- 
First GAIN staff were more lenient toward people who were still adjusting to life in a new country or were more 
inclined to believe that people with limited English proficiency were having trouble understanding Jobs-First 
GAIN’S mandatory participation requirements. 
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program staff. This pattern occurred in Jobs-First GAIN as well. Table 2.4 shows the rates and 
total hours of participation in Jobs-First GAIN and non-Jobs-First GAIN activities for AFDC- 
FGs in the two-year follow-up period. 

Among experimental group survey respondents (the only group for which data on Jobs- 
First GAIN and outside activities exist), about 40 percent reported participation in an activity 
outside Jobs-First GAIN. Half of these respondents had not participated in a Jobs-First GAIN 
activity according to DPSS records, whereas the remainder attended at least one activity within 
the program and another activity on their own initiative. Combining the proportion of experimen- 
tal group members who took part in a Jobs-First GAIN activity (42 percent) and the proportion 
who participated only outside the program (20 percent) yields an overall participation rate of 62 
percent. 13 

Experimental group members who took part in activities outside Jobs-First GAIN most 
often participated in vocational training or post-secondary education (see Table 2.4). Notably, 
about 20 percent of experimental group respondents reported attending post-secondary education 
classes, an activity that Jobs-First GAIN did not offer. In comparison, less than 10 percent of re- 
spondents took part in job search, basic education, work experience, or on-the-job training (OJT), 
although the levels of participation for survey respondents in three of these activities (all but job 
search) slightly exceeded the levels recorded for the whole sample of Jobs-First GAIN enrollees. 

E Comparison of Participation Levels in the Experimental and Control Groups 

Precluded from participating in Jobs-First GAIN activities, control group members often 
sought to enhance their job skills or earn an educational credential during the two years after ran- 
dom assignment (see Table 2.4). About 44 percent of control group members in the survey par- 
ticipated in an employment-related activity, usually vocational training or post-secondary educa- 
tion. Between 10 percent and 15 percent of control group respondents reported participation in 
job search or basic education, and fewer still in work experience or OJT. 14 

Experimental-control differences in participation represent the Jobs-First GAIN pro- 
gram’s impacts on participation. Welfare-to-work programs like Jobs-First GAIN may affect par- 
ticipation in several ways. They may 

1 . induce people who would not have attended on their own initiative to attend 
an employment-related activity; 



These percentages were calculated from survey responses. Activities reported by respondents but not recorded 
on GEARS were considered to have occurred outside Jobs-First GAIN. Survey-based participation rates were ad- 
justed (1) downward to compensate for respondents’ higher levels of participation in Jobs-First GAIN (as measured 
by GEARS) compared with the full experimental group and (2) upward to compensate for probable recall with er- 
ror. For each activity, the first adjustment factor was the participation rate for the full sample divided by the partici- 
pation rate for the survey sample; and the second adjustment factor was 0.5 multiplied by the rate of probable recall 
error. Recall error was estimated by dividing the percentage of experimental group respondents who did not report 
participation in a Jobs-First GAIN activity that was recorded on GEARS by the total percentage of experimental 
group members who participated in the Jobs-First GAIN activity. Applying these two adjustment factors changed 
participation rates in non-Jobs-First GAIN activities by only 0.2 to 3.0 percentage points, depending on the activity. 

For consistency, recorded participation rates for control group respondents were adjusted in the same way as 
for experimental group respondents. Data were unavailable for calculating these adjustment factors for control 
group respondents; therefore, the factors for experimental group respondents were used. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 2.4 
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2. change the type of activity that most people attend; or 

3. alter the total number of months or number of hours that people attend an 
employment-related activity. 

In the case of Jobs-First GAIN, the first of these effects was modest relative to other 
Work First programs. 15 The program raised overall the participation level about 18 percentage 
points above the control group level. The program produced a much larger (3 1 percentage point) 
increase in use of job search services, however, and a small increase (5 percentage points) in par- 
ticipation in unpaid work experience jobs. This pattern suggests that Jobs-First GAIN caused 
some experimental group members who would otherwise have attended only education and train- 
ing classes to attend Work First-type activities (see Table 2.4). 

About the same percentage of experimental and control group members attended educa- 
tion and training activities. In addition, the program did not increase the number of hours of par- 
ticipation among respondents who took part in these activities (see Table 2.4). 

G. Additional Effects 

1. Impacts on educational attainment. DPSS administrators did not intend Jobs- 
First GAIN to increase the proportion of welfare recipients who attained an education credential. 
As expected, about the same proportion of experimental and control group respondents (about 14 
percent) reported earning either a GED or a training certificate within two years of random as- 
signment. This rate of degree attainment for experimental group members is somewhat surpris- 
ing, given Jobs-First GAIN’S Work First orientation, but likely reflects their relatively high rates 
of participation in education and training activities outside the program (results not shown). 

2. Impacts on attitudes toward work and welfare. As discussed in Chapter 1, Jobs- 
First GAIN imparted a strong pro-work message that included both warnings about the impend- 
ing time limits on welfare and instruction about the financial advantages of combining work and 
welfare in the short term. Responses to the Two-Year Client Survey suggest that the program 
achieved modest success in conveying these messages. When asked at the two-year point, about 
45 percent of experimental group respondents indicated that they knew about welfare time limits 
compared with 42 percent of control group respondents, a difference that was not statistically 
significant (results not shown). On the other hand, Jobs-First GAIN decreased the proportion of 
respondents who believed that they could provide for their family better by staying on welfare 
than by working to 8 percentage points below the control group level of 24 percent (a statistically 
significant difference). In addition, a slightly smaller percentage of experimental group members 
indicated that they would rather stay home full time to take care of their family than work for 
pay, but the difference was not statistically significant (results not shown). 

IV. Results for AFDC-Us 

A. Rates of Assignment and Participation 

In general, members of two-parent families (AFDC-Us) showed similar patterns of par- 
ticipation and status in Jobs-First GAIN to those described above for single parents: Relatively 



l5 See Hamilton et al., 1997, Table 5.5, pp. 128-129; and Riccio et al., 1994, Table 2.5, p. 41. 
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few participated in Jobs-First GAIN activities, most attended one spell of job club, and very few 
were still participating in Jobs-First GAIN activities at the end of year 2 (see Table 2.5). Jobs- 
First GAIN case managers assigned 50 percent of AFDC-Us to a program activity — a lower as- 
signment rate than for AFDC-FGs (58 percent). About a third of AFDC-Us (34 percent) partici- 
pated in at least one activity for at least one day. This rate is slightly lower than that for two- 
parent families enrolled in the earlier, education-focused Los Angeles GAIN (36.0 percent) and 
about half that for two-parent families in the Riverside GAIN program (66.0 percent), both 
measured over one year of follow-up.' 6 A much larger percentage of AFDC-Us (32 percent) par- 
ticipated in job club than in every other activity. Only about 5 percent of AFDC-Us attended any 
of the education or training activities, including basic education. 17 

Nearly every AFDC-U experimental group member (92 percent) shifted to long-term 
nonmandatory status, that is, was deregistered, by the end of the two-year follow-up period. Most 
who were deregistered (57 percent) left mandatory status because of full-time employment. A 
much smaller percentage of AFDC-Us in the earlier, education- focused Los Angeles GAIN pro- 
gram (34 percent) were deregistered, whereas a similar proportion (80 percent) left Riverside 
GAIN. 18 As mentioned above, the Two-Year Client Survey sample included AFDC-FGs only. It 
is therefore not known how many experimental and control group members in the AFDC-U sam- 
ple attended education, training, or other employment-related activities outside Jobs-First GAIN 
on their own initiative. 

B. Participation Patterns for Key Subgroups 

As discussed in Chapter 1, the AFDC-U sample was relatively evenly divided between 
males and females. AFDC-U fathers had longer work histories than AFDC-U mothers, and 
would therefore be expected to have fewer difficulties finding employment after random assign- 
ment. Gender differences in work history and other background characteristics might have af- 
fected the experiences of male and female AFDC-Us in Jobs-First GAIN — for instance, the 
likelihood of their attending job club or the frequency with which they incurred a sanction or 
were deregistered. As shown in Table 2.6, male AFDC-Us had somewhat more contact with the 
program, but the differences between gender groups in patterns of participation and program 
status were not large. The participation level for AFDC-U men (37 percent) slightly exceeded 
that for AFDC-U women (32 percent), but a higher percentage of males than females incurred a 
sanction (26 percent versus 21 percent). In addition, deregistration rates were higher for males 
than females (95 percent versus 90 percent), especially for full-time employment (65 percent ver- 
sus 48 percent; results not shown). 

There was greater variation between subgroups defined by level of educational attain- 
ment, by race/ ethnicity, and by GAIN region in level of participation and frequency of incurring 
a sanction (see Table 2.6). For instance, 37 percent of AFDC-Us who entered Jobs-First GAIN 
without a high school diploma or GED certificate attended job club, compared with just 



Participation findings for AFDC-Us in the Riverside LFA program are not available at this time. 

These low rates of assignment and participation for AFDC-Us can be partially explained by the high propor- 
tion of AFDC-Us who received exemptions during their initial appraisal meetings: 18 percent were recommended 
for an exemption right at that time, and most of them were eventually deregistered from the program (results not 
shown). 

18 

See Friedlander, Riccio, and Freedman, 1993, Table 1.3, pp. 20-21. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 2.5 



Rates of Participation and Status Within Two Years of Orientation 
for AFDC-U Experimental Group Members 



Outcome (%) 


Assigned to any activity 3 


49.6 


Ever participated in b 




Any activity 0 


34.4 


Job search 


32.1 


Any education or training 


4.8 


Basic education 


2.3 


ESL 


1.4 


ABE 


0.3 


GED 


0.5 


High school 


0.2 


Vocational training 


2.9 


Work experience 


2.6 


OJT 


0.0 


Assessment 


4.3 


Deregistered for any reason d 


92.4 


For employment 


57.0 


For sanction 


31.7 


For other reason 


51.8 


In conciliation 


79.5 


Sanctioned 


23.4 


Deferred for any reason 


47.0 


For unapproved SIT 0 


6.9 


Sample size 


4,039 



SOURCE: MDRC calculations from the GAIN Employment Activity and Reporting System 
(GEARS). 



NOTES: 

Phe assignment rate includes assignment to all activities listed, except assessment. 

Participation rates include participation for at least one day in either a program-referred or 
approved self-initiated activity. 

c "Any activity" includes all activities listed, except assessment. 

d Subgroup percentages sum to more than the total deregistration percentage because some 
recipients were deregistered more than once during the follow-up period. 

c An SIT is a self-initiated activity ("self-initiated training"). 
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Table 2.6 

Rates of Participation and Status Among AFDC-U Experimental Group Members 
Within Two Years of Orientation, by Region and Subgroup 

Participated (%) 
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Table 2.6 (continued) 
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26 percent .of high school graduates or GED recipients. More dramatic differences in participa- 
tion level were observed among the four largest racial/ethnic subgroups of the AFDC-U sample. 
Specifically, participation levels for Hispanics and African-Americans (47 percent and 43 per- 
cent, respectively) were more than twice as high as those for whites and exceeded the levels for 
first- and second-generation immigrants from Vietnam, Cambodia, and every other Asian coun- 
try by nearly the same factor. African-Americans and Hispanics were also much more likely to 
incur a financial sanction during the first year of follow-up. Similarly, AFDC-Us from the San 
Fernando Valley, 60 percent of whom were white, were much less likely to participate in a Jobs- 
First GAIN activity than sample members residing elsewhere in the county. In contrast, AFDC- 
Us from the Southeastern region, nearly all of whom were Hispanic, had the highest level of par- 
ticipation of any racial/ethnic subgroup of AFDC-Us. As was the case for Hispanic AFDC-FGs, 
participation rates were about the same for Hispanic AFDC-Us with and without English profi- 
ciency. Among white and Asian AFDC-Us, a higher percentage of experimental group members 
who were proficient in English than of those who were not proficient in English participated in 
Jobs-First GAIN activities. 



Chapter 3 

Costs of Jobs-First GAIN 



The cost analysis presented in this chapter estimates how much the Los Angeles County 
welfare department (DPSS) and other government agencies spent to provide employment-related 
services to experimental and control group members in the Jobs-First GAIN Evaluation. The es- 
timates include expenditures by DPSS for Jobs-First GAIN activities and support services, as 
well as funds for Jobs-First GAIN activities that came from other agencies’ operating budgets. 
Further, the chapter estimates the average costs to outside providers of providing employment- 
related services that experimental and control group members sought out on their own initiative. 
This information will be useful to administrators and planners who want to understand the level 
of the government’s investment in Los Angeles’s Jobs-First GAIN program and compare the 
program’s effects to those of other types of welfare-to-work strategies. Moreover, the results of 
this analysis provide context for interpreting Jobs-First GAIN’S impacts and cost-effectiveness, 
which are reported in later chapters. 

The primary goal of the cost analysis is to estimate the average net cost to the government 
of providing employment and education-related services to members of the experimental group. 
The net cost is the difference between the average cost per experimental group member and the 
average cost per control group member of all Jobs-First GAIN and non- Jobs-First GAIN services 
used during the period studied. These costs include those of services provided from the date of 
random assignment until September 30, 1998. (Starting on October 1, 1998, all experimental and 
control group members still mandated to participate were enrolled in CalWORKs.) The period 
studied lasted from two years to two and a half years, depending on each sample member’s date 
of random assignment. Chapter 8 presents a benefit-cost analysis that addresses whether the eco- 
nomic gains to the government budget exceeded the additional expenditures required to provide 
Jobs-First GAIN services to experimental group members. This chapter begins with an overview 
of the major components of the cost analysis. It then discusses the cost estimates in detail for ex- 
perimental and control group members. 



I. Key Findings 

• The estimated total, or gross, cost (in 1998 dollars) of Jobs-First GAIN and 
non- Jobs-First GAIN activities per AFDC-FG experimental group member 
(including participants and nonparticipants) was $4,305. DPSS paid about 
$1,771 per experimental group member (41 percent of the gross cost), primar- 
ily for case management and the operation of the program’s motivational ori- 
entation session and job clubs. Another 1 5 percent of the cost was paid by 
schools and other agencies, mostly for basic education and vocational training 
for experimental group members assigned to these activities by Jobs-First 
GAIN. The remainder of the gross cost (about 44 percent) represents expendi- 
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tures paid by other agencies and institutions for non-Jobs-First GAIN activi- 
ties. 

• The experimental-control difference in cost, or net cost, of Los Angeles’s 
Jobs-First GAIN program — $1,392 per AFDC-FG experimental group mem- 
ber — was much smaller than its gross cost largely because of control group 
members’ relatively high levels of participation in education and training ac- 
tivities. 

• The estimated gross and net costs of Jobs-First GAIN for AFDC-U experi- 
mental group members averaged $2,485 and $1,170, respectively — less than 
the corresponding costs for AFDC-FGs. 

• Jobs-First GAIN’S gross and net costs fell well below those of the earlier, edu- 
cation-focused Los Angeles GAIN program and were comparable to those of 
Work First programs previously evaluated by MDRC. 



II. Ma jor Components of the Cost Analysis 

Figures 3.1 and 3.2 illustrate the cost components for the experimental and control groups 
in the AFDC-FG and AFDC-U samples, respectively. Costs were calculated for two categories of 
activities and services: those provided to meet Jobs-First GAIN requirements or support Jobs- 
First GAIN participation and those provided to support non-Jobs-First GAIN services and activi- 
ties. In each category, costs are further broken down into those paid by DPSS and those paid by 
non-welfare agencies. The figures show that the Jobs-First GAIN-related cost per experimental 
group member (Box 3) equals the expenditures incurred by DPSS to operate the program (Box 1) 
plus the expenditures incurred by non-welfare agencies (for example, adult basic education 
schools, community colleges, and proprietary schools) to provide education and training activities 
that met Jobs-First GAIN requirements (Box 2). The non-Jobs-First GAIN costs per experimental 
group member (Box 6) include the costs of services that experimental group members received 
on their own (Box 5), generally after leaving the program. The Jobs-First GAIN and non-Jobs- 
First GAIN costs per experimental group member make up the gross cost per experimental group 
member (Box 7). 

As discussed in Chapter 2, about 44 percent of control group members participated in 
non-Jobs-First GAIN activities on their own initiative. Box 9 displays the cost of these activities 
per control group member. Control group members were eligible to receive support service pay- 
ments from DPSS to cover child care, transportation, and other expenses related to their partici- 
pation in non-Jobs-First GAIN activities (Box 8). The sum of these costs (in Boxes 8 and 9) is 
the gross cost per control group member (Box 1 0). 

This chapter is organized to move through the boxes in Figures 3.1 and 3.2, beginning 
with Jobs-First GAIN-related expenditures and ending with the program’s net cost per experi- 
mental group member (Box 1 1 ). The net cost equals the gross cost per experimental group mem- 
ber (Box 7) less the amount that would have been spent in the program’s absence, that is, the 
gross cost per control group member (Box 10). The tables that follow show the above compo- 
nents broken down by activity and type of support service payment. 
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III. Jobs-First GAIN-Related Cost per AFDC-FG Experimental 
Group Member 

This section examines expenditures made by the welfare department and by non-welfare 
agencies for Jobs-First GAIN-related activities and support services for AFDC-FGs. 

A. Jobs-First GAIN-Related Expenditures by the Welfare Department 
(Figure 3.1. Box 1) 

Welfare department costs consisted of program operating costs paid by DPSS and the 
costs of support services that experimental group members received to enable their participation 
in Jobs-First GAIN. 

1. Operating costs. DPSS covered the expenditures for the day-to-day operation of 
the program, including expenditures for case management services, overhead, orientation to the 
program, job club, and work experience. 1 Payments made by DPSS to the County Office of Edu- 
cation for running orientations and job clubs and to outside organizations for providing unpaid 
work experience positions are included in welfare department costs (Box 1) and allocated across 
activities (see Table 3.2). Welfare department costs also include the expenditures for case man- 
agement associated with program referrals to education and training activities that other agencies 
and institutions funded. 2 Expenditures for actually operating these activities appear as non- 
welfare agency costs. 

Unit cost estimates are central to cost analysis. The unit cost of an activity is an estimate 
of the average cost of providing the activity to one person for a specified unit of time. Typically, 
MDRC collects agency participation and expenditure information for a “steady-state” period — 
that is, a one- to 12-month period during one fiscal year that falls within the follow-up period for 
the evaluation. Costs are then distributed among specific activities. It was beyond the scope of 
the present evaluation to estimate unit costs in this way. As a proxy, this analysis uses the unit 
costs of orientation, appraisal, and assessment; job search; basic education; and vocational train- 
ing or post-secondary education calculated for the earlier Los Angeles GAIN program and of 
work experience or on-the-job training (OJT) calculated for the Riverside Labor Force Attach- 
ment (LFA) program. These unit costs were expressed in 1998 dollars and used to estimate gross 
costs for both AFDC-FGs and AFDC-Us. 3 

Table 3.1 (columns 1 and 2) shows the welfare department unit costs of the five activities, 
and Table 3.2 (top panel, column 1) displays the average gross cost to the welfare department per 
experimental group member. To obtain the cost per experimental group member shown in Table 



'The staff costs of referring clients to Jobs-First GAIN are not included in this analysis. The costs of orientation 
and appraisal, however, are included, because only experimental group members attended these activities. 

2 Case management tasks include meeting with enrollees, arranging for support services, monitoring participa- 
tion, maintaining contact with providers, and enforcing participation mandates. 

3 For a detailed explanation of participant-months, unit costs, cost per experimental versus control group mem- 
ber, and other general methodological issues, see Riccio et al., 1994, Chapter 3, pp. 64-104, and Hamilton et al., 
1997, Chapter 7, pp. 165-169. 
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Los Angeles Jobs-First GAIN Evaluation 
Table 3.1 

Estimated Unit Costs of Employment-Related Activities per AFDC-FG Experimental and 

Control Group Member (in 1998 Dollars) 
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Table 3.2 (continued) 
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3.2 (top panel, column 1), the unit cost of each activity was multiplied by experimental group 
members’ average number of months of participation in that activity. (In addition, each experi- 
mental group member was credited with attending one orientation session, and monthly costs of 
orientation, appraisals, and assessments were added to her total.) Thus, the differences in gross 
cost between activities can be explained by differences in unit cost, participation level, and 
length of stay among those who took part. For example, the estimated welfare department unit 
cost of job search activities ($61 1) exceeded the unit cost of orientation, appraisal, and assess- 
ment ($572) by a small amount. The cost per experimental group member to the welfare depart- 
ment of job search activities was lower ($460 versus $656), however, because 37 percent of 
experimental group members participated in job search, whereas all experimental group members 
attended orientation (see Table 2.1). As Table 3.2 shows, the sum of all activities’ costs per ex- 
perimental group member yields a total Jobs-First GAIN welfare department operating cost of 
$ 1 ,442 per experimental group member. 

2. Support service costs. DPSS paid for child care, transportation, and ancillary ser- 
vices (for example, uniforms, tools, equipment, books, registration, and licensing fees) to help 
sample members participate in Jobs-First GAIN. Data on individual support service expenditures 
were collected for all experimental group members from the GAIN Employment Activity and 
Reporting System (GEARS) automated payment records. 

Table 3.2 (top panel, column 1) shows that the average total Jobs-First GAIN child care 
cost in Los Angeles was $258 per experimental group member. 4 About 23 percent of experimen- 
tal group members received a child care payment during the follow-up period (result not shown). 
These results fall within the same range as those for Work First programs previously evaluated 
by MDRC; the Job-First GAIN child care cost is somewhat below that of the earlier GAIN pro- 
gram in Los Angeles. 5 Jobs-First GAIN experimental group members received an average of $71 
to cover expenses for transportation to activities and to appointments with Jobs-First GAIN case 
managers and for ancillary expenses. 

3. Total Jobs-First GAIN-related costs incurred by the welfare department Ta- 
ble 3.2 (top panel, column 1) shows that Los Angeles’s welfare department paid a total of $ 1 ,771 
per experimental group member for Jobs-First GAIN services, including both operating and sup- 
port service expenditures. 



4 The total average includes an average of $3 1 in costs for child care owing to employment, which after April 
1 998 were paid under the provisions of the CalWORKs program. 

5 See Hamilton et al., 1997, Tables 7.2 and 7.3, pp. 170-171, and Riccio et al., 1994, Table 3.4, pp. 88-90. Aver- 
age child care costs (in 1993 dollars) ranged from $73 per enrollee in Riverside LFA to $709 per enrollee in Atlanta 
LFA, or from $80 to $779 in 1998 dollars. Between 17 percent and 31 percent of enrollees in the LFA programs in 
Atlanta, Grand Rapids, and Riverside received a child care payment within two years of random assignment. The 
GAIN program in Riverside County spent only $57 per experimental group member (in 1993 dollars) and Los An- 
geles GAIN spent $314 — or $63 and $345, respectively, in 1998 dollars. 
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